-- Logs begin at Fri 2022-05-20 08:29:02 UTC, end at Fri 2022-05-20 09:33:38 UTC. -- May 20 09:04:19.004677 dv-cinder-836996-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 20 09:04:19.015447 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 20 09:04:19 2022] *** May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: nodename: dv-cinder-836996-23-iscsi May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: machine: x86_64 May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: clock source: unix May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: pcre jit disabled May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: detected number of CPU cores: 4 May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: current working directory: / May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: detected binary path: /usr/bin/uwsgi-core May 20 09:04:19.017434 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: your processes number limit is 47680 May 20 09:04:19.018163 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: your memory page size is 4096 bytes May 20 09:04:19.018163 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: detected max file descriptor number: 2048 May 20 09:04:19.018163 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: lock engine: pthread robust mutexes May 20 09:04:19.018163 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: thunder lock: enabled May 20 09:04:19.018163 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 20 09:04:19.018163 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 20 09:04:19.062464 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: Python main interpreter initialized at 0x55fa256a29c0 May 20 09:04:19.062464 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: python threads support enabled May 20 09:04:19.062464 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: your server socket listen backlog is limited to 100 connections May 20 09:04:19.062464 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: your mercy for graceful operations on workers is 90 seconds May 20 09:04:19.062794 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: mapped 403077 bytes (393 KB) for 2 cores May 20 09:04:19.062794 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: *** Operational MODE: preforking *** May 20 09:04:19.063069 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: *** uWSGI is running in multiple interpreter mode *** May 20 09:04:19.063069 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: spawned uWSGI master process (pid: 103536) May 20 09:04:19.063306 dv-cinder-836996-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 20 09:04:19.063812 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: spawned uWSGI worker 1 (pid: 103537, cores: 1) May 20 09:04:19.064184 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: spawned uWSGI worker 2 (pid: 103538, cores: 1) May 20 09:04:19.064355 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 20 09:04:20.238889 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 20 09:04:20.241250 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 20 09:04:20.963934 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:04:20.963934 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: from cryptography.utils import int_from_bytes May 20 09:04:20.964216 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:04:20.964216 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: from cryptography.utils import int_from_bytes May 20 09:04:20.966647 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:04:20.966647 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: from cryptography.utils import int_from_bytes May 20 09:04:20.966944 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:04:20.966944 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: from cryptography.utils import int_from_bytes May 20 09:04:23.550270 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 09:04:23.550966 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 09:04:23.551338 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 09:04:23.551424 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 09:04:23.551491 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 09:04:23.551642 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 09:04:23.551718 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 09:04:23.551794 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 09:04:23.551860 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 09:04:23.551924 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 09:04:23.552002 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.552068 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.552340 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.552472 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.552623 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.552718 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.552946 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.553043 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.553295 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.553435 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.553610 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.553756 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.553923 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554052 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554213 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554354 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554553 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554696 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554783 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.554870 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.555117 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.555252 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.555437 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-23-iscsi {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.555524 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-23-iscsi {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.555757 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.555901 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.556065 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.556205 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.556383 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.556582 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.556679 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.556760 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.557008 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.557184 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.557333 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.557456 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.557583 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.557702 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.558096 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.558659 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.558659 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.558920 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559025 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559125 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559283 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559429 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559536 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559661 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559796 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.559916 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560047 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560165 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560364 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560500 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560622 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560738 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.560959 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.561143 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.561281 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.561403 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.561648 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-23-iscsi {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.561822 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-23-iscsi {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.561972 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.562104 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.562240 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.562366 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.562560 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.562733 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.562951 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.563097 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.563229 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.563375 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.563578 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.563711 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.563897 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564031 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564210 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564340 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564513 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564661 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564839 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.564969 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.565184 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.565313 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.565433 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.565598 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.565754 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.565873 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566051 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566176 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566317 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566436 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566635 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566768 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.566942 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567065 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567227 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567390 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567567 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567699 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567829 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.567946 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.568081 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.568199 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.568409 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.568546 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.568723 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.568855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569167 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569288 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569414 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569544 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569678 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569804 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.569924 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.570114 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.570241 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.570475 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.570604 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.570723 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.570840 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571006 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571131 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571297 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571430 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571620 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571754 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.571924 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.572049 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.572279 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.572409 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.572558 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.572692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.572882 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573016 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573189 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573328 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573507 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573631 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573811 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.573944 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.574124 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.574255 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.574510 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.574647 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.574766 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.574892 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.575041 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.575167 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.575403 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.575527 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.575702 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.575844 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576012 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576153 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576320 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576444 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576631 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576757 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.576931 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577056 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577234 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577371 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577509 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577633 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577833 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.577957 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578151 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578282 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578439 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578570 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578688 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578804 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.578981 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.579114 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.579246 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.579411 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.579602 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.579737 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.579910 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580032 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580208 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580335 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580490 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580695 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580819 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.580951 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581070 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581195 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581376 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581512 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581642 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581772 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.581960 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582085 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582260 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582383 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582559 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582691 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582863 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.582986 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.583166 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.583323 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.583474 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.583692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.583814 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.583942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.584098 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.584224 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.584410 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.584537 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.584710 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.584843 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585011 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585150 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585283 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585423 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585609 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585737 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585870 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.585989 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.586194 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.586333 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.586504 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.586638 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.586805 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.586928 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.587105 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.587232 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.587408 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.587528 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.587754 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.587880 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588061 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588188 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588373 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588511 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588631 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588757 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.588953 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589086 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589263 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589387 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589565 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589699 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589833 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.589950 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.590148 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.590281 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.590449 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.590581 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.590726 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.590910 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591032 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591150 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591319 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591465 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591632 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591763 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.591938 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592065 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592238 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592371 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592550 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592681 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592855 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.592989 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.593137 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.593269 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.593449 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.593579 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.593762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.593893 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:04:23.594086 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.594222 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.594413 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.594537 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.594749 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.594880 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.595046 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.595176 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.595402 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.595527 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.595729 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.595850 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596035 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596159 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596343 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596463 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596655 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596775 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.596976 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.597100 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.597284 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.597404 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.597590 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.597728 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.597896 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598024 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598208 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598341 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598521 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598702 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598841 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.598970 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.599145 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.599287 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.599484 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.599605 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.599799 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.599920 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.600106 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.600227 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.600417 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.600547 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.600739 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.600861 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.601057 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.601178 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.601351 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.601487 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.601683 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.601804 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602020 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602180 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602333 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602463 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602653 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602774 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.602972 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.603093 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.603305 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.603476 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.603663 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.603785 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.603973 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.604094 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.604297 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.604418 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.604603 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.604726 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.604912 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605033 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605224 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605346 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605530 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605652 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605863 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.605995 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.606124 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.606244 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.606425 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.606548 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.606731 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.606854 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607063 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607185 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607396 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607518 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607709 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607877 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.607998 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.608116 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.608313 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.608435 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.608621 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.608756 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.608930 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609051 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609234 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609363 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609533 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609663 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609834 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.609963 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.610135 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.610257 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.610439 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.610564 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.610741 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.610863 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.611102 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.611243 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.611421 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.611553 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.611697 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.611833 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612023 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612145 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612327 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612454 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612633 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612767 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.612941 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613062 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613247 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613380 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613547 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613668 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613854 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.613976 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.614160 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.614284 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.614461 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.614583 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.614778 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.614908 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.615086 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.615208 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.615416 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.615540 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.615735 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.615879 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616067 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616187 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616327 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616449 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616636 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616767 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.616942 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617064 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617252 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617391 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617558 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617688 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617862 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.617984 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.618183 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.618304 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.618492 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.618613 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.618800 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.618921 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.619154 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.619315 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.619508 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.619710 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.619832 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.619957 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.620119 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.620243 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.620442 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.620563 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.620756 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.620878 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621057 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621198 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621393 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621516 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621656 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621781 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.621954 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622084 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622253 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622374 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622557 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622678 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622860 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.622989 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.623158 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.623315 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.623485 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.623619 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.623786 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.623923 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.624085 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.624205 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.624404 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.624525 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.624708 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.624842 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625009 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625130 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625307 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625429 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625607 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625729 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.625947 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.626082 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.626274 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.626396 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.626573 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.626695 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.626899 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627217 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627371 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627561 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627683 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627868 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.627988 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.628179 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.628298 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.628485 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.628615 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.628791 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.628918 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.629098 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.629218 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.629404 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.629524 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.629718 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.629846 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630023 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630154 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630338 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630465 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630642 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630761 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.630962 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.631094 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.631281 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.631417 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.631599 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.631721 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.631894 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.632026 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.632204 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.632325 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.632541 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.632661 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.632869 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633073 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633195 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633312 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633489 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633612 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633793 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.633916 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.634105 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.634230 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.634410 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.634530 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.634790 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.634915 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.635101 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.635223 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.635438 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.635561 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.635756 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.635877 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636061 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636181 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636384 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636506 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636668 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636794 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.636988 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.637110 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.637295 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.637416 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.637608 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.637729 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.637908 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638030 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638216 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638346 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638537 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638657 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638866 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.638987 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.639174 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.639361 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.639494 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.639604 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.639809 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.639931 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.640118 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.640256 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.640424 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.640545 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.640727 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.640851 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641029 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641161 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641329 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641450 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641646 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641774 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.641939 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642068 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642244 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642364 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642545 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642673 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642844 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.642978 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.643155 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.643300 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.643487 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.643609 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.643789 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.643920 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.644090 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.644219 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.644396 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.644524 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.644713 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.644834 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645015 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645144 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645332 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645462 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645646 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645778 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.645948 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646069 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646246 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646395 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646586 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646715 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646856 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.646987 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.647155 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.647333 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.647480 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.647615 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.647783 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.647916 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.648117 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.648250 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.648421 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.648543 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.648720 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.648840 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649032 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649154 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649345 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649474 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649649 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649769 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.649956 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.650077 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.650284 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.650408 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.650588 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.650710 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.650902 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651211 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651353 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651542 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651664 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651874 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.651996 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.652143 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.652266 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.652449 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.652580 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.652754 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.652882 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653067 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653188 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653368 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653499 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653670 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653791 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.653973 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.654095 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.654271 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.654401 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.654576 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.654696 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.654886 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.655015 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.655498 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.655673 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.655797 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.655922 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.656089 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.656211 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.656403 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.656526 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.656722 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.656845 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657016 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657139 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657339 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657461 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657659 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657787 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.657994 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.658128 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.658327 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.658456 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.658576 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.658703 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.658875 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.659001 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.659174 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.659671 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.659854 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.659976 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.660155 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.660276 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.660454 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.660582 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.660754 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.660876 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661057 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661187 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661359 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661488 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661655 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661777 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.661979 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662111 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662232 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662350 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662531 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662655 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662826 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.662947 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.663132 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.663310 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.663444 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.663572 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.663755 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.663877 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664062 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664198 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664358 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664487 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664656 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664781 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.664955 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.665084 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.665288 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.665410 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.665590 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.665711 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.665969 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.666108 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.666296 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.666427 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.666633 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.666836 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.666971 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667103 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667234 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667390 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667549 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667672 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667853 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.667969 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.668153 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.668282 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.668449 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.668574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.668753 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.668874 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669054 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669182 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669352 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669476 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669656 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669777 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.669956 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670083 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670262 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670391 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670561 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670683 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670859 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.670983 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.671160 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.671349 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.671474 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.671601 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.671783 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.671908 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672102 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672232 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672374 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672498 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672669 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672790 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.672973 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673110 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673275 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673399 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673573 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673703 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673876 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.673997 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.674174 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.674294 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.674484 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.674612 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.674784 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.674907 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.675082 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.675205 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.675407 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.675528 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.675714 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.675836 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676023 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676143 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676319 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676439 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676638 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676763 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.676957 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677079 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677227 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677358 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677524 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677643 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677825 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.677948 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.678126 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.678257 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.678425 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.678545 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.678728 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.678856 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679044 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679175 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679378 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679503 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679679 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679812 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.679985 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.680116 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.680287 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.680420 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.680590 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.680719 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.680888 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681012 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681194 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681322 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681519 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681646 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681818 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.681939 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.682147 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.682275 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.682398 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.682523 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.682696 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.682819 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683012 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683142 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683334 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683474 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683637 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683758 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.683933 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684062 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684230 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684363 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684565 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684694 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684866 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.684988 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.685220 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.685423 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.685547 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.685671 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.685797 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.685916 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.686114 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.686246 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.686422 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.686544 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.686731 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.686852 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687048 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687185 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687348 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687469 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687656 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687780 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.687963 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.688095 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.688273 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.688406 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.688575 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.688696 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.688878 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689000 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689194 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689315 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689497 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689618 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689803 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.689924 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.690115 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.690236 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.690431 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.690553 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.690749 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.690871 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691049 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691176 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691377 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691501 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691686 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691810 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.691991 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.692114 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.692309 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.692446 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.692577 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.692704 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.692887 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693010 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693194 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693324 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693497 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693620 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693802 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.693923 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.694105 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.694235 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.694408 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.694537 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.694712 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.694832 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695011 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695142 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695334 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695459 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695657 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695779 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.695961 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696083 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696259 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696381 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696565 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696686 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696866 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.696996 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.697242 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.697371 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.697521 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.697644 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.697942 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698071 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698252 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698373 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698559 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698680 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698859 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.698982 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.699167 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.699308 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.699500 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.699640 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.699812 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.699942 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.700121 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.700249 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.700419 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.700554 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.700830 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.700951 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.701137 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.701256 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.701444 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.701580 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.701749 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.701870 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702050 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702172 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702420 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702564 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702688 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702814 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.702944 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703065 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703238 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703391 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703563 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703686 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703861 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.703982 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.704179 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.704301 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.704478 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.704601 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.704791 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.704912 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.705199 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.705321 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.705507 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.705628 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.705805 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.705935 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.706219 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.706349 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.706524 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.706653 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.706832 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.706961 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.707149 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.707301 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.707487 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.707608 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.707822 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.707958 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.708079 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.708216 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.708393 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.708515 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.708701 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.708822 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709017 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709152 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709335 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709465 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709640 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709761 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.709950 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.710079 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.710247 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.710369 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.710563 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.710685 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.710879 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.711012 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.711186 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.711348 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.711530 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.711652 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.711939 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.712069 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.712261 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.712383 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.712590 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.712737 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.712903 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713034 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713226 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713358 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713528 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713649 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713828 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.713949 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.714132 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.714256 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.714431 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.714554 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.714730 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.714852 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715045 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715176 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715365 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715499 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715672 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715795 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.715975 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716102 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716276 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716406 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716576 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716706 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716873 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.716993 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.717188 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.717319 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.717530 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.717663 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.717783 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.717910 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.718096 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.718227 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.718412 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.718535 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.718726 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.718848 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719025 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719147 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719364 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719499 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719670 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719802 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.719969 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.720091 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.720266 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.720390 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.720606 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.720734 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.720899 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721030 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721197 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721327 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721515 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721646 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721837 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.721959 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.722158 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.722279 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.722461 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.722591 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.722799 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.722936 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.723093 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.723217 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.723427 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.723562 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.723741 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.723864 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724059 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724181 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724357 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724532 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724668 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724796 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.724948 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725071 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725246 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725375 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725544 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725665 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725840 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.725966 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.726142 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.726264 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.726436 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.726557 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.726735 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.726857 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727031 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727163 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727365 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727503 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727709 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727831 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.727961 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.728081 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.728259 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.728431 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.728609 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.728739 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.728912 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729037 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729211 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729335 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729545 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729676 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729846 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.729969 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.730171 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.730294 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.730481 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.730612 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.730795 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.730926 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.731120 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.731243 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.731454 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.731659 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.731782 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.731901 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.732070 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.732193 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.732380 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.732510 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.732688 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.732826 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733024 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733147 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733297 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733421 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733607 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733729 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.733913 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734044 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734219 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734342 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734524 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734652 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734833 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.734964 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.735144 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.735331 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.735678 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.735810 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736001 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736130 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736306 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736429 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736613 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736735 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.736920 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737049 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737228 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737350 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737534 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737657 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737852 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.737983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.738129 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.738260 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.738431 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.738558 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.738735 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.738931 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.739060 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.739187 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.739379 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.739503 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.739699 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.739830 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740029 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740151 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740339 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740467 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740646 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740769 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.740951 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.741073 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.741260 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.741390 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.741607 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.741732 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.741915 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742036 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742213 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742344 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742519 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742641 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742826 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.742950 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.743158 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.743348 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.743481 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.743600 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.743728 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.743848 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744056 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744181 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744367 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744496 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744672 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744794 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.744976 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.745094 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.745284 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.745405 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.745589 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.745719 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.745906 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746029 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746234 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746548 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746678 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746853 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.746982 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.747160 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.747304 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.747492 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.747626 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748003 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748136 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748310 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748445 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748636 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748760 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.748953 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.749086 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.749271 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.749393 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.749580 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.749705 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.749891 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750014 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750212 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750343 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750513 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750637 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750813 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.750935 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.751118 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.751242 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.751452 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.751576 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.751753 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.751877 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752071 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752193 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752376 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752499 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752677 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752798 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.752988 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.753139 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.753322 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.753459 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.753807 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.753931 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.754150 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.754286 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.754463 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.754584 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.754786 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.754906 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.755106 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.755240 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.755448 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.755572 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.755752 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.755875 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756072 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756194 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756377 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756509 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756680 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756801 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.756994 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.757117 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.757302 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.757424 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.757601 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.757722 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.757903 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758100 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758229 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758349 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758498 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758622 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758801 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.758922 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.759103 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.759231 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.759428 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.759583 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.759802 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.759924 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.760106 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.760228 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.760410 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.760540 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.760709 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.760835 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761016 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761139 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761316 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761446 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761614 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761754 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.761914 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762035 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762210 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762340 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762517 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762639 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762814 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.762935 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.763118 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.763248 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.763477 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.763599 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.763718 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.763845 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764018 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764141 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764322 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764445 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764671 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764792 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.764987 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.765131 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.765668 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.765782 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.765885 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.765990 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766102 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766213 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766316 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766418 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766520 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766624 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.766873 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.767068 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.767177 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.767435 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.767637 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.767752 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.767855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.769971 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770246 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770246 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770472 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770591 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770698 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770803 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.770906 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771018 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771122 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771227 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771361 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771467 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771569 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771693 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771809 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.771914 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772024 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772127 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772239 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772460 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772564 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772666 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772666 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772870 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.772974 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773086 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773190 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773322 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773465 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773668 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773792 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.773910 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774036 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774155 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774286 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774405 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774523 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774640 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774759 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.774877 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775005 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775132 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775317 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775440 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775560 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775678 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775810 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.775932 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776050 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776169 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776295 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776425 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776545 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776671 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776791 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.776912 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777031 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777158 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777277 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777396 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777517 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777635 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777841 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.777980 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.778154 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.778363 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.778487 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.778608 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.778858 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.778983 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.779165 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.779334 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.779506 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.779630 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.779824 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.779946 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.780129 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.780251 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.780444 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.780573 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.780759 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.780882 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.781066 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.781188 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.781385 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.781517 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.781691 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.781813 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782016 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782138 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782347 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782481 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782673 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782797 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.782993 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.783121 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.783310 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.783453 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.783616 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.783818 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.783941 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.784061 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.784212 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.784677 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.784874 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.784995 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.785182 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.785304 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.785482 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.785603 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.785781 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.785911 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786083 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786206 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786383 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786506 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786680 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786801 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.786979 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.787103 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.787293 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.787419 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.787602 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.787736 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.787902 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788033 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788197 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788475 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788475 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788714 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788833 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.788960 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789082 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789201 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789349 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789471 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789652 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789783 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.789947 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.790069 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.790246 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.790367 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.790542 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.790677 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.790879 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791015 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791192 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791342 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791544 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791669 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791873 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.791996 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.792182 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.792305 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.792498 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.792622 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.792805 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.792935 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.793120 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.793237 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.793424 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.793554 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.793738 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.793939 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794070 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794190 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794347 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794472 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794650 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794781 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.794978 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.795109 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.795312 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.795453 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.795620 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.795749 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.795929 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796127 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796250 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796371 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796524 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796650 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796828 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.796959 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.797150 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.797280 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.797466 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.797588 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.797769 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.797903 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.798085 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.798206 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.798398 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.798535 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.798729 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.798851 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799008 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799131 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799335 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799461 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799659 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799783 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.799965 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800088 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800270 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800437 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800578 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800699 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800872 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.800994 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.801179 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.801314 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.801490 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.801612 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.801800 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.801922 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.802121 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.802252 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.802441 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.802562 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.802743 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.802864 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.803064 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.803197 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.803411 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.803535 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.803755 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.803878 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.804085 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.804214 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.804385 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.804509 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.804710 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.804833 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805020 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805145 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805326 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805626 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805747 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:04:23.805876 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 09:04:23.806003 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 09:04:23.863978 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Registered counter for database nova_api May 20 09:04:23.864184 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO dbcounter [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Registered counter for database nova_api May 20 09:04:23.887924 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:23.889657 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_db.sqlalchemy.engines [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:23.895763 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:23.896095 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writer thread running {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:23.951281 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.context [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfb14b34-4b8d-44b3-b921-227f159daefa(cell1) {{(pid=103538) load_cells /opt/stack/nova/nova/context.py:464}} May 20 09:04:23.951500 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.context [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfb14b34-4b8d-44b3-b921-227f159daefa(cell1) {{(pid=103537) load_cells /opt/stack/nova/nova/context.py:464}} May 20 09:04:23.956767 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:04:23.956934 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:04:23.958341 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:04:23.958561 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:04:23.959121 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:04:23.959367 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:04:23.961081 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:04:23.961251 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_concurrency.lockutils [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:04:23.963105 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO dbcounter [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Registered counter for database nova_cell0 May 20 09:04:23.963274 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Registered counter for database nova_cell0 May 20 09:04:23.967140 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO dbcounter [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Registered counter for database nova_cell1 May 20 09:04:23.967304 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Registered counter for database nova_cell1 May 20 09:04:23.976036 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_db.sqlalchemy.engines [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:23.977774 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_db.sqlalchemy.engines [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:23.979312 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:23.982670 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:23.984232 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writer thread running {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:23.985589 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:23.986177 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writer thread running {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:24.123497 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:24.128123 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO dbcounter [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Registered counter for database nova_cell0 May 20 09:04:24.132571 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO dbcounter [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Registered counter for database nova_cell0 May 20 09:04:24.136823 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_db.sqlalchemy.engines [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:24.141213 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writer thread running {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:24.141994 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:04:24.146411 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writer thread running {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:04:24.469646 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:04:24.471564 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: WARNING keystonemiddleware.auth_token [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:04:24.476916 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:04:24.478937 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: WARNING keystonemiddleware.auth_token [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:04:24.817492 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:04:24.820524 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: WARNING keystonemiddleware.auth_token [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:04:24.823679 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: WARNING keystonemiddleware.auth_token [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:04:24.826691 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: WARNING keystonemiddleware.auth_token [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:04:24.828945 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa256a29c0 pid: 103537 (default app) May 20 09:04:24.830993 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:04:24.831995 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa256a29c0 pid: 103538 (default app) May 20 09:04:24.832164 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b4e96022-4027-49ed-949c-b727ee8ddba4 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 May 20 09:04:24.832559 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Fri May 20 09:04:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:42.662877 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:42.664089 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 May 20 09:05:42.664481 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:42.676044 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:42.677014 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:42.677975 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell1:SELECT=3 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:42.679060 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:43.107109 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-7b21b29d-ae7f-48fe-b821-06b262d6bf96 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:43.139638 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-7b21b29d-ae7f-48fe-b821-06b262d6bf96 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469055 May 20 09:05:43.140437 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 2/3] 10.222.0.69 () {60 vars in 1291 bytes} [Fri May 20 09:05:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:05:45.388434 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:45.389422 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-b64bdfda-5f38-40a4-9b99-82538a6428d2 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 20 09:05:45.389793 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 2/4] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:45.450364 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-fb2f4443-20e7-4ad9-a8c8-5c6ab0a28e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:45.469780 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:05:45.469780 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: warnings.warn(msg) May 20 09:05:45.501209 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-fb2f4443-20e7-4ad9-a8c8-5c6ab0a28e89 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105490 May 20 09:05:45.503301 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 3/5] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:05:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 20 09:05:45.515684 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_api:SELECT=3 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:45.516700 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_cell0:SELECT=3 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:45.518193 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_cell1:SELECT=3 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:45.519131 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:05:45.721197 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-b63a65d7-46bd-40ee-82c2-edf70d93979a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:45.723702 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:05:45.723702 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: warnings.warn(msg) May 20 09:05:45.799554 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-b63a65d7-46bd-40ee-82c2-edf70d93979a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289302 May 20 09:05:45.800463 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 3/6] 10.222.0.69 () {64 vars in 1335 bytes} [Fri May 20 09:05:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:05:48.049429 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-fb2f4443-20e7-4ad9-a8c8-5c6ab0a28e89 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:48.050392 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-fb2f4443-20e7-4ad9-a8c8-5c6ab0a28e89 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 20 09:05:48.050788 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 4/7] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:48.169221 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-b667e25c-b167-46fb-b013-90578656f5d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "ram": 512, "disk": 5, "rxtx_factor": 1.0}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:48.186823 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:05:48.186823 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: warnings.warn(msg) May 20 09:05:48.207630 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-b667e25c-b167-46fb-b013-90578656f5d0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150913 May 20 09:05:48.208188 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 4/8] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:05:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:05:48.220219 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-706f524a-1227-4fb4-ab2b-cc62d324e521 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:48.221904 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:05:48.221904 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: warnings.warn(msg) May 20 09:05:48.254473 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-706f524a-1227-4fb4-ab2b-cc62d324e521 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038098 May 20 09:05:48.255032 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 5/9] 10.222.0.69 () {64 vars in 1335 bytes} [Fri May 20 09:05:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:05:50.516084 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-b667e25c-b167-46fb-b013-90578656f5d0 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:50.517095 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-b667e25c-b167-46fb-b013-90578656f5d0 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 20 09:05:50.517499 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:50.582401 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-88ca4121-c0d2-4d10-b691-1dc12b797f8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "swap": 0, "id": "d2", "vcpus": 1}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:50.605197 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-88ca4121-c0d2-4d10-b691-1dc12b797f8d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081883 May 20 09:05:50.605965 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 6/11] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:05:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 20 09:05:50.618085 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-9672526b-a53e-4f19-badf-a0a655e9fc5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:50.643663 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-9672526b-a53e-4f19-badf-a0a655e9fc5b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029319 May 20 09:05:50.644208 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 6/12] 10.222.0.69 () {64 vars in 1335 bytes} [Fri May 20 09:05:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:05:52.892322 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-88ca4121-c0d2-4d10-b691-1dc12b797f8d admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:52.893480 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-88ca4121-c0d2-4d10-b691-1dc12b797f8d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 May 20 09:05:52.893988 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 7/13] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:05:52.960799 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-f0d4f2e8-669b-4655-9b34-05b4e9ee0c09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:52.982009 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-f0d4f2e8-669b-4655-9b34-05b4e9ee0c09 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078328 May 20 09:05:52.982574 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 7/14] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:05:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:05:52.994575 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-8357b078-8461-42b6-bb4b-d54f8472a6c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:53.023591 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-8357b078-8461-42b6-bb4b-d54f8472a6c6 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032678 May 20 09:05:53.024513 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 8/15] 10.222.0.69 () {64 vars in 1335 bytes} [Fri May 20 09:05:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:05:55.289691 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-f0d4f2e8-669b-4655-9b34-05b4e9ee0c09 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:55.290756 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-f0d4f2e8-669b-4655-9b34-05b4e9ee0c09 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 20 09:05:55.291124 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 8/16] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:55.353699 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-65d46856-3b95-4982-bbce-43b046cfc8cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:55.373407 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-65d46856-3b95-4982-bbce-43b046cfc8cd admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076151 May 20 09:05:55.373927 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 9/17] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:05:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 20 09:05:55.388496 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-145b1ec6-1fec-4d6f-848d-8271d1b65d05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:05:55.424193 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-145b1ec6-1fec-4d6f-848d-8271d1b65d05 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041338 May 20 09:05:55.427742 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 9/18] 10.222.0.69 () {64 vars in 1335 bytes} [Fri May 20 09:05:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:05:57.677412 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-65d46856-3b95-4982-bbce-43b046cfc8cd admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:57.678426 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-65d46856-3b95-4982-bbce-43b046cfc8cd admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 20 09:05:57.678823 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 10/19] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:05:57.739013 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-55bdc652-36e0-4f98-bf23-e1b7dcbaf141 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:05:57.762932 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-55bdc652-36e0-4f98-bf23-e1b7dcbaf141 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077984 May 20 09:05:57.763648 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 10/20] 10.222.0.69 () {60 vars in 1291 bytes} [Fri May 20 09:05:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:00.044165 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-65d46856-3b95-4982-bbce-43b046cfc8cd admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:00.045071 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-65d46856-3b95-4982-bbce-43b046cfc8cd admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 20 09:06:00.045454 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 11/21] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:00.118405 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-8c238e45-4c9b-4545-a1f9-798606a68a99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:00.141906 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-8c238e45-4c9b-4545-a1f9-798606a68a99 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089926 May 20 09:06:00.142582 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 11/22] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:06:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:00.156179 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-e39b1108-e8c8-4823-9ff1-cf38c3cbf233 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:00.184227 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-e39b1108-e8c8-4823-9ff1-cf38c3cbf233 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032217 May 20 09:06:00.184836 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 12/23] 10.222.0.69 () {64 vars in 1332 bytes} [Fri May 20 09:06:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:06:02.452001 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-8c238e45-4c9b-4545-a1f9-798606a68a99 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:02.453020 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-8c238e45-4c9b-4545-a1f9-798606a68a99 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 20 09:06:02.453426 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 12/24] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:02.512111 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-026bfbce-3ab9-487c-9cdc-36abf0bfcc90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "name": "m1.small", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:02.532180 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-026bfbce-3ab9-487c-9cdc-36abf0bfcc90 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072090 May 20 09:06:02.533243 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 13/25] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:06:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:02.546432 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-e83ff696-7bab-4fc2-8684-5cdf25aeea3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:02.570012 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-e83ff696-7bab-4fc2-8684-5cdf25aeea3b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027468 May 20 09:06:02.570597 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 13/26] 10.222.0.69 () {64 vars in 1332 bytes} [Fri May 20 09:06:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:06:04.829282 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-026bfbce-3ab9-487c-9cdc-36abf0bfcc90 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:04.830254 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-026bfbce-3ab9-487c-9cdc-36abf0bfcc90 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004060 May 20 09:06:04.830683 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 14/27] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:04.892948 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-640becf1-34a2-4341-aa64-1c5ba15f24a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:04.914491 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-640becf1-34a2-4341-aa64-1c5ba15f24a2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077689 May 20 09:06:04.915036 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 14/28] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:06:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:04.926892 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-6c5910f1-9923-4bce-a3a9-1cba86f022b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:04.951646 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-6c5910f1-9923-4bce-a3a9-1cba86f022b8 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028355 May 20 09:06:04.952611 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 15/29] 10.222.0.69 () {64 vars in 1332 bytes} [Fri May 20 09:06:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:06:07.178987 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-640becf1-34a2-4341-aa64-1c5ba15f24a2 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:07.180673 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-640becf1-34a2-4341-aa64-1c5ba15f24a2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 May 20 09:06:07.181073 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 15/30] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:07.236497 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-fdfe4864-8c1e-41f3-91a1-3c005f542216 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "disk": 80, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:07.259791 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-fdfe4864-8c1e-41f3-91a1-3c005f542216 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072595 May 20 09:06:07.260361 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 16/31] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:06:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:07.275083 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-170bc49a-1062-49c1-9726-97a2fc93d2c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:07.299412 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-170bc49a-1062-49c1-9726-97a2fc93d2c2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028136 May 20 09:06:07.299972 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 16/32] 10.222.0.69 () {64 vars in 1332 bytes} [Fri May 20 09:06:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:06:09.531828 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-fdfe4864-8c1e-41f3-91a1-3c005f542216 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:09.533329 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-fdfe4864-8c1e-41f3-91a1-3c005f542216 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 May 20 09:06:09.533872 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 17/33] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:06:09.599863 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-18ded67e-d458-402c-b1cb-83ae3f9609b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:09.620482 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-18ded67e-d458-402c-b1cb-83ae3f9609b4 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080735 May 20 09:06:09.621114 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 17/34] 10.222.0.69 () {64 vars in 1282 bytes} [Fri May 20 09:06:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 20 09:06:09.634091 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-1809583d-9655-4214-bbfa-7e8f0c09e582 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:09.659008 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-1809583d-9655-4214-bbfa-7e8f0c09e582 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028595 May 20 09:06:09.659851 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 18/35] 10.222.0.69 () {64 vars in 1332 bytes} [Fri May 20 09:06:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:06:35.231522 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-18ded67e-d458-402c-b1cb-83ae3f9609b4 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:35.232520 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-18ded67e-d458-402c-b1cb-83ae3f9609b4 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 20 09:06:35.232913 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 18/36] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:35.243667 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:06:35.295709 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-81f2c5ca-f29c-4c6c-b96e-88a4274e845a admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:35.312615 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-81f2c5ca-f29c-4c6c-b96e-88a4274e845a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073566 May 20 09:06:35.313118 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 19/37] 10.222.0.69 () {60 vars in 1291 bytes} [Fri May 20 09:06:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:36.325683 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-18ded67e-d458-402c-b1cb-83ae3f9609b4 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:36.326690 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-18ded67e-d458-402c-b1cb-83ae3f9609b4 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 20 09:06:36.327085 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 19/38] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:36.546096 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-bcbefe32-cb1d-4b6f-83de-da2f06d842fe admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:36.552085 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-bcbefe32-cb1d-4b6f-83de-da2f06d842fe admin admin] HTTP exception thrown: Flavor 42 could not be found. May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-bcbefe32-cb1d-4b6f-83de-da2f06d842fe admin admin] Request method failure captured: May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Accept: application/json May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Connection: keep-alive May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Content-Length: 0 May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Host: 10.222.0.69 May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABih1oc7WYs0OwRVFPeP6Xmal1Z7mBuYNBEflO3gdt3dQ0Y0XqyB35C_VDxMcb7Tyx_XL9LMMxED5aysquhTYVp_IhK71MLvshzu92mPbIwXkwrRHDSQg7bx9NPDs6L62JaBC3S30Dy7PWaVKWl-5TkAwvV2i5hHUmkjskm45w6WlcUg4M May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Domain-Id: None May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Domain-Name: None May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Name: admin May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Role: admin,reader,member May 20 09:06:36.555477 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Roles: admin,reader,member May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aac440dc4ce14fa1a6d365f33d6d214c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}] May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant: admin May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User: admin May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Id: ce1d4da72fcf4acabf4a7749465fe917 May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Name: admin May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: method: > May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: exception: Flavor 42 could not be found. May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: action_args: {'id': '42'} May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:06:36.556942 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:36.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:36.558971 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-bcbefe32-cb1d-4b6f-83de-da2f06d842fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:06:36.560174 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-bcbefe32-cb1d-4b6f-83de-da2f06d842fe admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069951 May 20 09:06:36.560174 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 20/39] 10.222.0.69 () {60 vars in 1190 bytes} [Fri May 20 09:06:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 20 09:06:36.567293 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-f55aa2f1-9148-4972-98a2-7bb57c093b47 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:36.570346 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:06:36.590925 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-f55aa2f1-9148-4972-98a2-7bb57c093b47 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027239 May 20 09:06:36.591477 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 20/40] 10.222.0.69 () {60 vars in 1210 bytes} [Fri May 20 09:06:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:36.602992 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f76ac992-d548-40cb-857c-3ba36e61107b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:36.626384 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-f76ac992-d548-40cb-857c-3ba36e61107b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026965 May 20 09:06:36.626924 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 21/41] 10.222.0.69 () {60 vars in 1210 bytes} [Fri May 20 09:06:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:36.636538 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-ce6700ff-f5a6-44e7-9c42-cdda4b3c3211 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:36.643184 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.wsgi [None req-ce6700ff-f5a6-44e7-9c42-cdda4b3c3211 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-ce6700ff-f5a6-44e7-9c42-cdda4b3c3211 admin admin] Request method failure captured: May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Accept: application/json May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Accept-Encoding: gzip, deflate May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Connection: keep-alive May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Content-Length: 0 May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Host: 10.222.0.69 May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Openstack-Api-Version: compute 2.90 May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Openstack-System-Scope: None May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: User-Agent: python-novaclient May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Auth-Token: gAAAAABih1oc7WYs0OwRVFPeP6Xmal1Z7mBuYNBEflO3gdt3dQ0Y0XqyB35C_VDxMcb7Tyx_XL9LMMxED5aysquhTYVp_IhK71MLvshzu92mPbIwXkwrRHDSQg7bx9NPDs6L62JaBC3S30Dy7PWaVKWl-5TkAwvV2i5hHUmkjskm45w6WlcUg4M May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Domain-Id: None May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Domain-Name: None May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Identity-Status: Confirmed May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Is-Admin-Project: True May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Openstack-Nova-Api-Version: 2.90 May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Domain-Id: default May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Domain-Name: Default May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Name: admin May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Role: admin,reader,member May 20 09:06:36.646447 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Roles: admin,reader,member May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aac440dc4ce14fa1a6d365f33d6d214c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}] May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant: admin May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant-Name: admin May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User: admin May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Domain-Id: default May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Domain-Name: Default May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Id: ce1d4da72fcf4acabf4a7749465fe917 May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Name: admin May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: method: > May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: exception: Flavor 42 could not be found. May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: action_args: {'id': '42'} May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:06:36.647983 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:36.648845 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:36.649928 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-ce6700ff-f5a6-44e7-9c42-cdda4b3c3211 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:06:36.650991 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-ce6700ff-f5a6-44e7-9c42-cdda4b3c3211 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015043 May 20 09:06:36.650991 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 21/42] 10.222.0.69 () {60 vars in 1190 bytes} [Fri May 20 09:06:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 20 09:06:37.527824 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-f76ac992-d548-40cb-857c-3ba36e61107b admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:37.528834 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-f76ac992-d548-40cb-857c-3ba36e61107b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 20 09:06:37.529224 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 22/43] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:37.732433 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-2bc914b4-ba84-44af-9ee3-4f7294245f12 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:37.738054 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.wsgi [None req-2bc914b4-ba84-44af-9ee3-4f7294245f12 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-2bc914b4-ba84-44af-9ee3-4f7294245f12 admin admin] Request method failure captured: May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Accept: application/json May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Accept-Encoding: gzip, deflate May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Connection: keep-alive May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Content-Length: 0 May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Host: 10.222.0.69 May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Openstack-Api-Version: compute 2.90 May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Openstack-System-Scope: None May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: User-Agent: python-novaclient May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Auth-Token: gAAAAABih1od2EzVAKeHvCU07k9pveAN3so7ocMQ0SbjAXRx9YR5pRCKzFFthLPS33CGjh8Dcp-2PasZC-eIxTNVMZrlU61pnDgMlqoYldPWeYZwN8Vdg9gtLlYzVifYCDhaep4GA2NtaiUckGe9aCpbuDsjvqzlg-jqcvZWFkLhK3kNoVrHhJM May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Domain-Id: None May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Domain-Name: None May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Identity-Status: Confirmed May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Is-Admin-Project: True May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Openstack-Nova-Api-Version: 2.90 May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Domain-Id: default May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Domain-Name: Default May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Name: admin May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Role: admin,reader,member May 20 09:06:37.739598 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Roles: admin,reader,member May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aac440dc4ce14fa1a6d365f33d6d214c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}] May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant: admin May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant-Name: admin May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User: admin May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Domain-Id: default May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Domain-Name: Default May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Id: ce1d4da72fcf4acabf4a7749465fe917 May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Name: admin May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: method: > May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: exception: Flavor 84 could not be found. May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: action_args: {'id': '84'} May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:06:37.741146 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:37.742137 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:37.743196 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-2bc914b4-ba84-44af-9ee3-4f7294245f12 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:06:37.744302 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-2bc914b4-ba84-44af-9ee3-4f7294245f12 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076213 May 20 09:06:37.744302 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 22/44] 10.222.0.69 () {60 vars in 1190 bytes} [Fri May 20 09:06:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 20 09:06:37.751021 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-9976b67e-fab2-4189-9b48-d5e87b1206d4 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:37.767526 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-9976b67e-fab2-4189-9b48-d5e87b1206d4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020072 May 20 09:06:37.768080 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 23/45] 10.222.0.69 () {60 vars in 1210 bytes} [Fri May 20 09:06:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:06:37.778306 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-8f9dcb75-c559-437a-acc9-7032140283a6 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:37.793270 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-8f9dcb75-c559-437a-acc9-7032140283a6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018741 May 20 09:06:37.793816 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 23/46] 10.222.0.69 () {60 vars in 1210 bytes} [Fri May 20 09:06:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:37.803498 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-62c03b21-b540-4a33-bd26-a658fdbe81cd admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:37.809235 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-62c03b21-b540-4a33-bd26-a658fdbe81cd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-62c03b21-b540-4a33-bd26-a658fdbe81cd admin admin] Request method failure captured: May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Accept: application/json May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Connection: keep-alive May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Content-Length: 0 May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Host: 10.222.0.69 May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABih1od2EzVAKeHvCU07k9pveAN3so7ocMQ0SbjAXRx9YR5pRCKzFFthLPS33CGjh8Dcp-2PasZC-eIxTNVMZrlU61pnDgMlqoYldPWeYZwN8Vdg9gtLlYzVifYCDhaep4GA2NtaiUckGe9aCpbuDsjvqzlg-jqcvZWFkLhK3kNoVrHhJM May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Domain-Id: None May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Domain-Name: None May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Name: admin May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Role: admin,reader,member May 20 09:06:37.810762 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Roles: admin,reader,member May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aac440dc4ce14fa1a6d365f33d6d214c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}] May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant: admin May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User: admin May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Id: ce1d4da72fcf4acabf4a7749465fe917 May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Name: admin May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: method: > May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: exception: Flavor 84 could not be found. May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: action_args: {'id': '84'} May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:06:37.812356 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:37.813291 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:37.814574 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-62c03b21-b540-4a33-bd26-a658fdbe81cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:06:37.815820 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-62c03b21-b540-4a33-bd26-a658fdbe81cd admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012385 May 20 09:06:37.815820 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 24/47] 10.222.0.69 () {60 vars in 1190 bytes} [Fri May 20 09:06:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 20 09:06:38.734918 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-8f9dcb75-c559-437a-acc9-7032140283a6 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:38.736450 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-8f9dcb75-c559-437a-acc9-7032140283a6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 May 20 09:06:38.737021 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 24/48] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:38.952703 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b1fec871-956d-4b0c-a75b-aa1c92f74a82 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:38.964283 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.wsgi [None req-b1fec871-956d-4b0c-a75b-aa1c92f74a82 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b1fec871-956d-4b0c-a75b-aa1c92f74a82 admin admin] Request method failure captured: May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Accept: application/json May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Accept-Encoding: gzip, deflate May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Connection: keep-alive May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Content-Length: 0 May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Host: 10.222.0.69 May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Openstack-Api-Version: compute 2.90 May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Openstack-System-Scope: None May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: User-Agent: python-novaclient May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Auth-Token: gAAAAABih1oe0R-0clPl_isi6ysaDqA3HloF2vy3aoPE6Pc7mSRNM9p4FWJd4gpmy2FNTy0Pg7tfP1JYlAzH5JvH8SA3tSzXylYO1VrSVGSRhj0InPoh5OYaL6BbxpOBmrXlnC6BOjAn5QdPvLTYOmyO8ffbVrrZLKuO6OL3tndrvMZ3brCaiz8 May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Domain-Id: None May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Domain-Name: None May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Identity-Status: Confirmed May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Is-Admin-Project: True May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Openstack-Nova-Api-Version: 2.90 May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Domain-Id: default May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Domain-Name: Default May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Project-Name: admin May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Role: admin,reader,member May 20 09:06:38.966019 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Roles: admin,reader,member May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aac440dc4ce14fa1a6d365f33d6d214c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}] May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant: admin May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-Tenant-Name: admin May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User: admin May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Domain-Id: default May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Domain-Name: Default May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Id: ce1d4da72fcf4acabf4a7749465fe917 May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: X-User-Name: admin May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: method: > May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: exception: Flavor 451 could not be found. May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: action_args: {'id': '451'} May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:06:38.967708 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:38.968692 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: ERROR nova.api.openstack.wsgi May 20 09:06:38.970038 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-b1fec871-956d-4b0c-a75b-aa1c92f74a82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:06:38.971238 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-b1fec871-956d-4b0c-a75b-aa1c92f74a82 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.093631 May 20 09:06:38.971238 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 25/49] 10.222.0.69 () {60 vars in 1193 bytes} [Fri May 20 09:06:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 20 09:06:38.983806 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-bf3cb919-27eb-4615-926f-7b8ab1351222 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:39.002439 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-bf3cb919-27eb-4615-926f-7b8ab1351222 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023763 May 20 09:06:39.003000 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 25/50] 10.222.0.69 () {60 vars in 1210 bytes} [Fri May 20 09:06:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:39.012986 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:39.033149 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023481 May 20 09:06:39.033693 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 26/51] 10.222.0.69 () {60 vars in 1210 bytes} [Fri May 20 09:06:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:06:39.043576 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-13de79ed-2f3e-4204-873f-eead79f6461e admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:39.049565 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.wsgi [None req-13de79ed-2f3e-4204-873f-eead79f6461e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-13de79ed-2f3e-4204-873f-eead79f6461e admin admin] Request method failure captured: May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Accept: application/json May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Accept-Encoding: gzip, deflate May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Connection: keep-alive May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Content-Length: 0 May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Host: 10.222.0.69 May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Openstack-Api-Version: compute 2.90 May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Openstack-System-Scope: None May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: User-Agent: python-novaclient May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Auth-Token: gAAAAABih1oe0R-0clPl_isi6ysaDqA3HloF2vy3aoPE6Pc7mSRNM9p4FWJd4gpmy2FNTy0Pg7tfP1JYlAzH5JvH8SA3tSzXylYO1VrSVGSRhj0InPoh5OYaL6BbxpOBmrXlnC6BOjAn5QdPvLTYOmyO8ffbVrrZLKuO6OL3tndrvMZ3brCaiz8 May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Domain-Id: None May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Domain-Name: None May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Identity-Status: Confirmed May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Is-Admin-Project: True May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Openstack-Nova-Api-Version: 2.90 May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Domain-Id: default May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Domain-Name: Default May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Project-Name: admin May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Role: admin,reader,member May 20 09:06:39.051162 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Roles: admin,reader,member May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aac440dc4ce14fa1a6d365f33d6d214c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aac440dc4ce14fa1a6d365f33d6d214c"}]}] May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant: admin May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant-Id: aac440dc4ce14fa1a6d365f33d6d214c May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-Tenant-Name: admin May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User: admin May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Domain-Id: default May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Domain-Name: Default May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Id: ce1d4da72fcf4acabf4a7749465fe917 May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: X-User-Name: admin May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: method: > May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: exception: Flavor 451 could not be found. May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: action_args: {'id': '451'} May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:06:39.052707 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:39.053717 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: ERROR nova.api.openstack.wsgi May 20 09:06:39.055253 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-13de79ed-2f3e-4204-873f-eead79f6461e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:06:39.056562 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-13de79ed-2f3e-4204-873f-eead79f6461e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012685 May 20 09:06:39.056562 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 26/52] 10.222.0.69 () {60 vars in 1193 bytes} [Fri May 20 09:06:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 20 09:06:39.937421 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:39.938419 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 20 09:06:39.938805 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 27/53] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:40.131053 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-b8e8fcad-54dd-40b0-9649-1c4322d559a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:40.154771 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-b8e8fcad-54dd-40b0-9649-1c4322d559a5 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080797 May 20 09:06:40.155398 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 27/54] 10.222.0.69 () {64 vars in 1235 bytes} [Fri May 20 09:06:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:41.046588 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:41.046588 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 20 09:06:41.046588 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 28/55] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:41.243046 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-0fee2440-3041-481c-837c-00a316506346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:41.263156 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-0fee2440-3041-481c-837c-00a316506346 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082122 May 20 09:06:41.263766 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 28/56] 10.222.0.69 () {64 vars in 1235 bytes} [Fri May 20 09:06:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:42.153443 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:42.154438 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 20 09:06:42.154798 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 29/57] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:42.345880 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-1754ed97-8c58-4748-8bad-42ec9f36c53f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:42.366919 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-1754ed97-8c58-4748-8bad-42ec9f36c53f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.078592 May 20 09:06:42.367539 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 29/58] 10.222.0.69 () {64 vars in 1235 bytes} [Fri May 20 09:06:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:43.260771 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:43.261771 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 20 09:06:43.262151 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 30/59] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:43.459426 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-d45e42aa-c736-4609-9db0-d54d83c6b0ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:06:43.481446 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-d45e42aa-c736-4609-9db0-d54d83c6b0ff admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084492 May 20 09:06:43.481985 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 30/60] 10.222.0.69 () {64 vars in 1235 bytes} [Fri May 20 09:06:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:06:44.378959 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:44.380298 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 May 20 09:06:44.380815 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 31/61] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:06:44.585570 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-e51803ac-32e4-4b57-a6c5-50f333921bf2 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:06:44.605121 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-e51803ac-32e4-4b57-a6c5-50f333921bf2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.088839 May 20 09:06:44.605646 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 31/62] 10.222.0.69 () {60 vars in 1202 bytes} [Fri May 20 09:06:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:07:46.171047 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:07:46.172731 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-c90dab9d-b970-4ec3-8f81-1b6f7aaa4bd9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002296 May 20 09:07:46.173363 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 32/63] 10.222.0.69 () {54 vars in 930 bytes} [Fri May 20 09:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:07:46.188084 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:07:46.246616 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-99608aab-013c-4fb8-b4ac-3666ebf622be admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:07:46.266785 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-99608aab-013c-4fb8-b4ac-3666ebf622be admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.087001 May 20 09:07:46.267315 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 32/64] 10.222.0.69 () {60 vars in 1291 bytes} [Fri May 20 09:07:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:07:46.289625 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG dbcounter [-] [103537] Writing DB stats nova_api:SELECT=14 {{(pid=103537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:07:46.295141 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-80ba74a6-2f52-4518-830e-503cf1c45b2d admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:07:46.307420 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-80ba74a6-2f52-4518-830e-503cf1c45b2d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019855 May 20 09:07:46.308134 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 33/65] 10.222.0.69 () {60 vars in 1282 bytes} [Fri May 20 09:07:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:07:46.319490 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-7fdae2ef-dd1c-4e9a-b527-08dc88b81246 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:07:46.327198 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-7fdae2ef-dd1c-4e9a-b527-08dc88b81246 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011317 May 20 09:07:46.327733 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 33/66] 10.222.0.69 () {60 vars in 1285 bytes} [Fri May 20 09:07:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:07:46.338396 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:07:46.346783 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011799 May 20 09:07:46.347314 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 34/67] 10.222.0.69 () {60 vars in 1285 bytes} [Fri May 20 09:07:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:07:46.358812 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-9884bd10-6304-4d4b-bfb6-d3cb2a7c578f admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:07:46.366373 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-9884bd10-6304-4d4b-bfb6-d3cb2a7c578f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011362 May 20 09:07:46.366870 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 34/68] 10.222.0.69 () {60 vars in 1282 bytes} [Fri May 20 09:07:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:11:17.290339 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:17.291622 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 May 20 09:11:17.292164 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 35/69] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:11:17.452428 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_api:SELECT=6 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:11:17.581724 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-9bccdeb3-b3e9-4693-a069-c8398f15c860 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:17.583596 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:11:17.583596 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: warnings.warn(msg) May 20 09:11:17.585373 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-9bccdeb3-b3e9-4693-a069-c8398f15c860 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:17.585915 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-9bccdeb3-b3e9-4693-a069-c8398f15c860 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:17.586915 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-9bccdeb3-b3e9-4693-a069-c8398f15c860 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:17.587719 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-9bccdeb3-b3e9-4693-a069-c8398f15c860 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:17.624404 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-9bccdeb3-b3e9-4693-a069-c8398f15c860 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.173398 May 20 09:11:17.627313 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 35/70] 10.222.0.69 () {60 vars in 1193 bytes} [Fri May 20 09:11:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:11:18.527184 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:18.528654 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001904 May 20 09:11:18.529013 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 36/71] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:11:18.739855 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-7b933a3e-883c-4490-8eb1-b8b8b91753f1 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:18.741509 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:11:18.741509 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: warnings.warn(msg) May 20 09:11:18.743317 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-7b933a3e-883c-4490-8eb1-b8b8b91753f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:18.743830 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-7b933a3e-883c-4490-8eb1-b8b8b91753f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:18.745025 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-7b933a3e-883c-4490-8eb1-b8b8b91753f1 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:18.745643 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-7b933a3e-883c-4490-8eb1-b8b8b91753f1 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:18.765948 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-7b933a3e-883c-4490-8eb1-b8b8b91753f1 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.100655 May 20 09:11:18.766655 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 36/72] 10.222.0.69 () {60 vars in 1193 bytes} [Fri May 20 09:11:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:11:30.138628 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:30.139722 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 20 09:11:30.140113 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 37/73] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:11:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:11:30.280673 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_cell0:SELECT=4 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:11:30.281368 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_cell1:SELECT=4 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:11:30.281965 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG dbcounter [-] [103538] Writing DB stats nova_api:SELECT=8 {{(pid=103538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:11:30.339725 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-4145db47-5895-48bc-b8a0-2040119b6d15 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:30.341438 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:11:30.341438 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: warnings.warn(msg) May 20 09:11:30.343200 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-4145db47-5895-48bc-b8a0-2040119b6d15 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:30.343854 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-4145db47-5895-48bc-b8a0-2040119b6d15 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:30.345034 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-4145db47-5895-48bc-b8a0-2040119b6d15 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:30.345651 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-4145db47-5895-48bc-b8a0-2040119b6d15 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:30.376192 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-4145db47-5895-48bc-b8a0-2040119b6d15 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.100282 May 20 09:11:30.376723 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 37/74] 10.222.0.69 () {60 vars in 1193 bytes} [Fri May 20 09:11:30 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:11:31.273545 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: DEBUG nova.api.openstack.wsgi [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] Calling method '>' {{(pid=103537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:31.274554 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: INFO nova.api.openstack.requestlog [None req-4afcab83-d493-4def-920d-ed24e1ba5030 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 20 09:11:31.274956 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: [pid: 103537|app: 0|req: 38/75] 10.222.0.69 () {56 vars in 1074 bytes} [Fri May 20 09:11:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:11:31.478102 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG nova.api.openstack.wsgi [None req-23857994-5141-472d-b04d-609034db8890 admin admin] Calling method '>' {{(pid=103538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:11:31.479246 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 20 09:11:31.479246 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: warnings.warn(msg) May 20 09:11:31.480527 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-23857994-5141-472d-b04d-609034db8890 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:31.480953 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-23857994-5141-472d-b04d-609034db8890 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:31.481736 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-23857994-5141-472d-b04d-609034db8890 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:11:31.482151 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: DEBUG oslo_concurrency.lockutils [None req-23857994-5141-472d-b04d-609034db8890 admin admin] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:11:31.503558 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: INFO nova.api.openstack.requestlog [None req-23857994-5141-472d-b04d-609034db8890 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.090944 May 20 09:11:31.504090 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: [pid: 103538|app: 0|req: 38/76] 10.222.0.69 () {60 vars in 1193 bytes} [Fri May 20 09:11:31 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:12:27.984875 dv-cinder-836996-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 20 09:12:27.985898 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: Fri May 20 09:12:27 2022 - graceful shutdown triggered... May 20 09:12:27.986440 dv-cinder-836996-23-iscsi devstack@n-api.service[103537]: Gracefully killing worker 1 (pid: 103537)... May 20 09:12:27.986819 dv-cinder-836996-23-iscsi devstack@n-api.service[103538]: Gracefully killing worker 2 (pid: 103538)... May 20 09:12:28.987141 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: worker 1 buried after 1 seconds May 20 09:12:28.987141 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: worker 2 buried after 1 seconds May 20 09:12:28.987141 dv-cinder-836996-23-iscsi devstack@n-api.service[103536]: goodbye to uWSGI. May 20 09:12:28.988774 dv-cinder-836996-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 20 09:12:28.989364 dv-cinder-836996-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 20 09:12:28.992133 dv-cinder-836996-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 20 09:12:29.007806 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 20 09:12:29 2022] *** May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: nodename: dv-cinder-836996-23-iscsi May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: machine: x86_64 May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: clock source: unix May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: pcre jit disabled May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: detected number of CPU cores: 4 May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: current working directory: / May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: detected binary path: /usr/bin/uwsgi-core May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: your processes number limit is 47680 May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: your memory page size is 4096 bytes May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: detected max file descriptor number: 2048 May 20 09:12:29.032144 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: lock engine: pthread robust mutexes May 20 09:12:29.033075 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: thunder lock: enabled May 20 09:12:29.033075 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 20 09:12:29.033075 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 20 09:12:29.078186 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: Python main interpreter initialized at 0x55aea5f639c0 May 20 09:12:29.078186 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: python threads support enabled May 20 09:12:29.078186 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: your server socket listen backlog is limited to 100 connections May 20 09:12:29.078186 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: your mercy for graceful operations on workers is 90 seconds May 20 09:12:29.078682 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: mapped 403077 bytes (393 KB) for 2 cores May 20 09:12:29.078682 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: *** Operational MODE: preforking *** May 20 09:12:29.078904 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: *** uWSGI is running in multiple interpreter mode *** May 20 09:12:29.078904 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: spawned uWSGI master process (pid: 117959) May 20 09:12:29.079129 dv-cinder-836996-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 20 09:12:29.079746 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: spawned uWSGI worker 1 (pid: 117980, cores: 1) May 20 09:12:29.080101 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: spawned uWSGI worker 2 (pid: 117981, cores: 1) May 20 09:12:29.080404 dv-cinder-836996-23-iscsi devstack@n-api.service[117959]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 20 09:12:30.269903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 20 09:12:30.273356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 20 09:12:31.062075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:12:31.062075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: from cryptography.utils import int_from_bytes May 20 09:12:31.062424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:12:31.062424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: from cryptography.utils import int_from_bytes May 20 09:12:31.062584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:12:31.062584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: from cryptography.utils import int_from_bytes May 20 09:12:31.062749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 20 09:12:31.062749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: from cryptography.utils import int_from_bytes May 20 09:12:33.489825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 09:12:33.490537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 09:12:33.490650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 09:12:33.490985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 09:12:33.491319 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 09:12:33.491660 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.491985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.492307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.492623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.492954 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.493264 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.493587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.493904 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.494251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.494453 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.494786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.495105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-23-iscsi {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.495453 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.495758 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.496093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.496443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.496741 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.497080 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.497383 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.497883 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.498616 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.498927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.499252 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.499601 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.499916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.500226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.500548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.500861 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.501186 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.501494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.501898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-23-iscsi {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.502223 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.503121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.503121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.503474 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.503673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.503874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.504195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.504522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.504835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.505160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.505480 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.505802 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.506124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.506430 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.506740 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.507054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.507398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.507597 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 20 09:12:33.507996 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.508082 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 20 09:12:33.508156 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.508238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.508533 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.508625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 20 09:12:33.508856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.508938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 20 09:12:33.509182 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.509311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 20 09:12:33.509635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.509919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.510027 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.510261 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.510571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.510682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.511744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.511850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.511936 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512034 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512125 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512312 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512776 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512776 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.512962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513219 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-23-iscsi {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513484 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.513969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514275 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514371 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514610 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.514963 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.515166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.515331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.515519 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.515740 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.515938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516078 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.516990 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.517152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.517316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.517447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.517607 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.517746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.517884 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518021 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518615 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.518892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.519075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-23-iscsi {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.519202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.519409 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.519527 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.519715 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.519834 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520473 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520681 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.520999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.521094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.521306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.521424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.521612 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.521714 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.521912 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522210 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522518 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522824 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.522934 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.523128 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.523222 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.523447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.523540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.523751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.523853 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524359 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524658 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524759 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.524952 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525197 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525811 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.525924 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.526128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.526580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.526771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.526874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527392 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527652 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527754 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.527980 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.528194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.528358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.528496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.528636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.528788 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.528935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529241 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529515 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529661 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.529953 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.530100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.530243 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.530390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.530602 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.530742 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.530875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531011 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531153 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531330 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531476 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.531937 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532375 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532510 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.532924 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533205 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533347 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533490 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533789 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.533964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534248 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534675 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534819 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.534981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.535115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.535393 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.535531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.535683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.535829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.535974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.536120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.536120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.536392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.536536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.536671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.536807 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.536953 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.537098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.537239 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.537381 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.537533 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.537666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.537797 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.537929 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.538078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.538214 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.538359 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.538504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.538640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.538775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.538923 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.539061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.539195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.539358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.539569 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.539762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.539925 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.540076 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.540215 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.540360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.540506 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.540673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.540823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.540961 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.541106 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.541254 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.541414 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.541569 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.541705 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.541846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.541989 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.542158 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.542291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.542501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.542637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.542842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.543048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.543141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.543226 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.543346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.543449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.543676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.543831 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.543933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.544031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.544270 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.544421 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.544561 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.544674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.544881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.545031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.545152 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.545251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.545492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.545632 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.545763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.545873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.546092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.546230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.546379 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.546491 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.546703 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.546844 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.547010 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.547149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.547283 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.547376 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.547684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.548169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.548266 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.548364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.548460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.548580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.548677 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.548770 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.548871 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.548956 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.549120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.549282 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.549415 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.549517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.549752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.549905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.550014 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.550116 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.550341 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.550489 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.550592 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.550688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.550939 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 20 09:12:33.551078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.551315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.551468 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.551575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.551668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.551896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552035 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552340 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.552932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.553138 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.553232 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.553444 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.553552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.553749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.553847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554060 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554481 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554670 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.554972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.555072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.555286 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.555396 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.555612 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.555705 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.555919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556020 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556233 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556634 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.556946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.557147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.557254 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.557457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.557559 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.557755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.557855 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.558071 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.558172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.558356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.558452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.558717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.558812 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.559035 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.559134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.559540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560020 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560404 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560579 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.560911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561003 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561547 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561647 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.561940 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.562162 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.562261 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.562467 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.562566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.562771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.562860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.563075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.563174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.563400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.563507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.563707 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.563810 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564015 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564151 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564704 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.564919 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565009 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565616 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565831 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.565921 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.566136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.566233 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.566436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.566535 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.566734 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.566824 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.567077 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.567168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.567451 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.567546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.567768 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.567868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.568091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.568190 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.568418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.568519 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.568722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.568825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569139 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.569963 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570265 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570565 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570871 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.570961 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.571174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.571324 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.571504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.571606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.571819 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.571919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.572124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.572215 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.572423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.572522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.572737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.572835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573434 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.573964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.574079 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.574312 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.574417 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.574623 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.574726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.574929 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.575987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.576185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.576287 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.576501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.576629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.576803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.576906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.577120 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.577212 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.577431 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.577545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.577740 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.577850 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578040 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578438 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.578946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579383 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579570 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.579980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.580170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.580264 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.580472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.580566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.580810 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581343 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581661 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.581967 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.582086 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.582269 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.582448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.582594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.582743 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.582892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583593 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583802 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.583892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.584108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.584207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.584422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.584512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.584732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.584836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585033 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585434 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.585953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586390 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.586994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.587141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.587306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.587467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.587574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.587773 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.587867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.588094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.588203 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.588397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.588502 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.588705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.588794 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.589002 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.589092 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.589313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.589415 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.589637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.589727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590426 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.590943 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.591040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.591269 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.591433 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.591573 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.591720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.591870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592009 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592158 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.592891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593329 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593476 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.593903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594357 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.594942 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.595077 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.595216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.595428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.595585 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.595755 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.595906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.596046 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.596186 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.596333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.596637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.596735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.596940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597089 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597383 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597681 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.597960 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598262 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598558 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.598972 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.599166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.599369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.599513 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.599623 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.599850 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600013 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600593 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600705 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.600803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601191 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.601945 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602207 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602529 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602788 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.602877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.603123 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.603316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.603417 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.603536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.603733 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.603888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604003 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604314 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604468 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604794 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.604995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.605224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.605366 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.605556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.605699 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.605811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.605896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.606145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.606244 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.606449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.606555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.606751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.606854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607054 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607797 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.607996 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.608104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.608300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.608404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.608601 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.608711 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.608905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609322 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609621 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.609921 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.610115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.610220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.610410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.610507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.610707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.610818 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.611994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.612211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.612340 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.612536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.612635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.612828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.612929 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.613129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.613227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.613429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.613526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.613740 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.613844 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614348 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614438 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614656 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614756 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.614962 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615130 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615405 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615572 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615679 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615879 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.615976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.616179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.616274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.616494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.616603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.616780 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.616885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617082 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617191 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617381 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617476 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.617980 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618074 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618278 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618689 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618885 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.618986 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.619185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.619306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.619506 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.619613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.619821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.619915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.620123 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.620226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.620422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.620531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.620720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.620816 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621150 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621371 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621465 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621676 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.621986 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.622089 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.622290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.622394 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.622597 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.622722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.622904 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623225 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.623929 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.624124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.624216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.624421 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.624512 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.624724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.624891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625024 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625128 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625320 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625729 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.625926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626229 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626319 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626530 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.626975 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.627191 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.627314 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.627513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.627614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.627821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.627919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.628124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.628222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.628423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.628528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.628722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.628824 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629321 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629617 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.629921 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630020 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630218 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630626 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.630928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.631126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.631217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.631497 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.631596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.631803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.631985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.632153 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.632263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.632423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.632524 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.632732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.632837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633351 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.633956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634256 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634655 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634862 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.634952 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.635166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.635251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.635507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.635599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.635808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.635906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.636112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.636197 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.636408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.636505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.636727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.636828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637027 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637118 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637631 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637723 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.637929 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.638039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.638229 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.638321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.638527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.638668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.638858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639020 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639741 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.639919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640332 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640551 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640674 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.640951 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.641170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.641253 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.641555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.641648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.641868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642312 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642458 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.642881 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643051 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643190 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643379 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643690 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.643995 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644299 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644398 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.644987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.645209 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.645307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.645516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.645614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.645821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.645918 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.646138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.646237 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.646454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.646546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.646775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.646938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.647074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.647280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.647390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.647613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.647728 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.647940 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.648041 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.648265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.648356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.648566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.648655 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.648877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649056 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649518 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649659 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.649955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650245 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650395 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650542 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.650980 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.651120 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.651625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.651721 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.651873 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.651984 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.652179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.652311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.652549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.652671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.652856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.653086 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.653183 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.653415 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.653514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.653728 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.653821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654051 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654142 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654378 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654476 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.654985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.655076 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.655323 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.655431 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.655629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.655720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.655930 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656027 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656236 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656537 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656629 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.656949 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.657154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.657246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.657461 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.657555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.657767 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.657877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.658067 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.658166 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.658380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.658506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.658685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.658786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659165 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.659926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660355 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660653 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660800 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.660946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.661141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.661290 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.661450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.661601 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.661760 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.661907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.662085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.662225 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.662392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.662535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.662713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.662864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663163 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663348 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663773 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.663971 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664275 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.664994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.665210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.665305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.665516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.665694 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.665841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.665994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666562 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666693 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.666981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.667117 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.667300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.667398 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.667606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.667713 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.667927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.668062 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.668241 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.668373 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.668572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.668692 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.668879 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669014 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669200 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669320 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669813 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.669925 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.670119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.670211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.670423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.670515 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.670765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.670853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.671073 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.671155 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.671441 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.671557 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.671747 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.671857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672054 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672354 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.672968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673260 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673400 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673693 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.673991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.674136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.674276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.674444 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.674586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.674733 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.674888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675359 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.675960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.676107 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.676247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.676392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.676570 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.676825 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.676978 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.677126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.677270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.677454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.677618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.677839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.677999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.678134 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.678281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.678421 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.678572 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.678710 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.678858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679002 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679434 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.679898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680196 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680604 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.680895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.681098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.681193 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.681395 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.681527 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.681773 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.681957 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.682100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.682262 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.682388 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.682559 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.682745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.682851 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.683064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.683165 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.683409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.683507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.683779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.683896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.684096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.684200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.684412 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.684514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.684722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.684826 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685022 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685794 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.685959 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686054 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686267 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686361 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686576 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686670 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.686982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.687190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.687321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.687536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.687631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.687854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688015 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688400 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688541 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.688958 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.689102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.689333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.689472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.689608 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.689752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.689896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690041 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690188 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690325 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.690961 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.691129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.691357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.691483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.691685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.691777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.691996 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.692116 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.692306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.692424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.692613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.692715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.692926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693539 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.693939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.694146 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.694228 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.694450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.694550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.694770 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.694985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.695085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.695362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.695477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.695683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.695776 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696014 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696330 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.696945 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697271 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697373 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697670 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.697975 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.698184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.698305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.698496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.698605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.698796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.698900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.699098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.699217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.699452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.699544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.699764 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.699854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700157 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700760 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.700975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.701983 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.702203 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.702293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.702511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.702613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.702811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.702904 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.703116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.703205 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.703444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.703653 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.703753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.703971 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.704069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.704298 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.704397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.704620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.704713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.704932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705329 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.705967 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.706172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.706263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.706472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.706571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.706779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.706878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.707083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.707184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.707406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.707511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.707726 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.707826 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708137 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.708949 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.709051 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.709476 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.709581 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.709819 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.709912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.710130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.710234 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.710450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.710541 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.710775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.710900 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.711078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.711180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.711397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.711494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.711705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.711798 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712617 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.712973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713632 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.713945 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.714130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.714226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.714427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.714530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.714730 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.714867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.715077 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.715182 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.715419 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.715531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.715721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.715813 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716138 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716320 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.716922 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717223 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717520 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717615 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.717910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.718121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.718236 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.718421 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.718546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.718720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.718814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719018 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719123 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719347 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.719951 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.720045 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.720295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.720425 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.720613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.720744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.720915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.721066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.721213 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.721392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.721521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.721705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.721824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.722980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.723076 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.723310 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.723425 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.723635 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.723906 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724334 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724558 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724660 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724886 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.724988 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.725190 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.725283 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.725497 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.725599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.725798 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.725891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.726100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.726201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.726408 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.726502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.726712 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.726820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727014 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727656 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.727962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728066 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728363 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728691 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.728989 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.729179 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.729272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.729477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.729578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.729780 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.729873 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.730083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.730175 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.730382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.730503 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.730708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.730804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731017 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731111 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731354 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.731972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732067 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732276 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732672 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732888 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.732994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.733192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.733302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.733504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.733605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.733828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.733937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.734136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.734240 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.734440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.734534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.734758 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.734857 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.735081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.735189 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.735432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.735539 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.735753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.735861 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736153 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736470 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.736994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.737089 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.737322 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.737417 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.737606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.737699 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.737921 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738329 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738554 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738873 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.738968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.739177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.739368 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.739501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.739690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.739803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.739906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.740106 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.740208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.740417 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.740522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.740720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.740823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741017 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741118 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.741919 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742012 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742318 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.742907 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.743121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.743246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.743437 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.743534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.743736 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.743830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744034 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744136 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744329 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744628 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.744925 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.745062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.745227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.745379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.745528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.745725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.745822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.746101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.746208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.746422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.746517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.746732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.746827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.747034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.747135 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.747297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 09:12:33.747395 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.747701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.748019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.748325 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.748641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.748947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.749262 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.749580 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.749889 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.750193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.750520 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.750827 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.751132 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.751467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.751775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.752080 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.752383 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.752708 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.753029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.753332 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.753649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.753962 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.754276 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.754586 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.754888 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.755210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.755540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.755846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.756156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.756461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.756764 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.757074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.757384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.757702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.758021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.758325 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.758642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.758960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.759323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.759632 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.759970 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.760292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.760601 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.760908 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.761206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 20 09:12:33.761445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 20 09:12:33.806873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Registered counter for database nova_api May 20 09:12:33.822884 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Registered counter for database nova_api May 20 09:12:33.827570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:33.835541 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:33.842092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:33.850047 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:33.891403 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.context [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfb14b34-4b8d-44b3-b921-227f159daefa(cell1) {{(pid=117981) load_cells /opt/stack/nova/nova/context.py:464}} May 20 09:12:33.895876 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:12:33.897413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:12:33.898208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:12:33.900218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:12:33.902624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Registered counter for database nova_cell0 May 20 09:12:33.906003 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.context [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfb14b34-4b8d-44b3-b921-227f159daefa(cell1) {{(pid=117980) load_cells /opt/stack/nova/nova/context.py:464}} May 20 09:12:33.906776 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Registered counter for database nova_cell1 May 20 09:12:33.910427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:12:33.912022 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:12:33.912786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:12:33.914089 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:33.914771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:12:33.915812 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:33.916832 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Registered counter for database nova_cell0 May 20 09:12:33.920993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Registered counter for database nova_cell1 May 20 09:12:33.921136 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:33.934487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:33.935251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:33.942225 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:33.943508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:34.060552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:34.071306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Registered counter for database nova_cell0 May 20 09:12:34.078873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:34.084181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:34.091912 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Registered counter for database nova_cell0 May 20 09:12:34.099936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 20 09:12:34.104676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 20 09:12:34.403170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:12:34.410642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:12:34.417591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:12:34.426198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:12:34.756857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:12:34.763141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-5f9f5d99-92cc-430d-bdf1-f9d1abf66aa0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:12:34.768501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aea5f639c0 pid: 117981 (default app) May 20 09:12:34.774069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 20 09:12:34.780681 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-aff90aa7-8242-4c8d-8349-4811b9fe84b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 20 09:12:34.786014 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aea5f639c0 pid: 117980 (default app) May 20 09:13:16.000511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:16.002556 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:16.004944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:16.007741 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:17.318101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-70487319-fe7a-4805-a0fd-981d59ab554a tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Action: 'create', calling method: .version_select at 0x7f7c8d5f8550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2051419363"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:19.654764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-70487319-fe7a-4805-a0fd-981d59ab554a tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.660085 May 20 09:13:19.655686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1154 bytes} [Fri May 20 09:13:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3662 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 20 09:13:19.669666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:19.670517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:19.672227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:19.674254 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:20.246433 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c57c261d-f299-40ee-b6e5-9204f1e194fd tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d642280>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:21.070279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c57c261d-f299-40ee-b6e5-9204f1e194fd tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261" status: 200 len: 346 microversion: 2.1 time: 1.405999 May 20 09:13:21.070970 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 1/2] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:13:19 2022] GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 => generated 346 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:21.084038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fd45f87f-969c-4cff-b883-2cd06c8099e9 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Action: 'create', calling method: .version_select at 0x7f7c8d511430>, body: {"snapshot": {"volume_id": "07c6fd47-e58e-441f-b467-65525ea64261", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-532524217"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:21.236896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-396982324", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "networks": [{"uuid": "f436d993-53fd-4882-b0ef-cefd5c9953db"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:21.490615 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] validate_networks() for [('f436d993-53fd-4882-b0ef-cefd5c9953db', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:13:21.597341 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fd45f87f-969c-4cff-b883-2cd06c8099e9 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.517138 May 20 09:13:21.598008 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 2/3] 10.222.0.69 () {60 vars in 1161 bytes} [Fri May 20 09:13:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:21.607949 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f2054c5b-c074-4d88-9daa-894a0e65bfd4 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d511ca0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:21.722408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f2054c5b-c074-4d88-9daa-894a0e65bfd4 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.118317 May 20 09:13:21.723424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 3/4] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:21 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:21.738925 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8e3bc6ac-8554-4ecb-abc4-0e38740232bd tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d511790>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:21.831294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8e3bc6ac-8554-4ecb-abc4-0e38740232bd tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.101893 May 20 09:13:21.832220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 4/5] 10.222.0.69 () {58 vars in 1139 bytes} [Fri May 20 09:13:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:21.842125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fc90254e-ae35-44a9-8183-86192bb3d781 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d4cf940>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:21.894159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fc90254e-ae35-44a9-8183-86192bb3d781 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.055891 May 20 09:13:21.894843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 5/6] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:21 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:22.906511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-65e04d04-3150-4bc1-8c9d-b70ff83fa3d7 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d5115e0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:23.009986 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-65e04d04-3150-4bc1-8c9d-b70ff83fa3d7 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.107357 May 20 09:13:23.010768 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 6/7] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:22 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:23.641674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:13:23.642789 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:13:23.643764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:13:23.644431 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:13:23.645488 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:13:23.660526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:23.661380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:23.662361 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:23.662988 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:23.710467 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Getting quotas for project e84fe8cfef0c4aa3a55dccc8f9aaddc9. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:23.721114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Getting quotas for user 90438171f42e4d74bd4e73bfb39ac91d and project e84fe8cfef0c4aa3a55dccc8f9aaddc9. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:23.755352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:13:23.758377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:13:23.951896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-89e401d4-cd72-4b87-88b9-e2a18a6d3086 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.989584 May 20 09:13:23.953967 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 2/8] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:13:23.972214 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a70f081c-8bb9-4202-b748-e6983aac5660 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:23.972987 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a70f081c-8bb9-4202-b748-e6983aac5660 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:24.022460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2eccf1c5-d81c-480a-9787-4e9ad02d09ab tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8c36b0d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:24.073604 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2eccf1c5-d81c-480a-9787-4e9ad02d09ab tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.055299 May 20 09:13:24.074676 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 3/9] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:24 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:24.195299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a70f081c-8bb9-4202-b748-e6983aac5660 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:24.224777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a70f081c-8bb9-4202-b748-e6983aac5660 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1214 microversion: 2.1 time: 0.265218 May 20 09:13:24.228084 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 7/10] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:23 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:25.085818 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f2b79daf-fc9d-4e8a-b49f-c7436d63cafb tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d511670>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:25.148853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f2b79daf-fc9d-4e8a-b49f-c7436d63cafb tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 287 microversion: 2.1 time: 0.066888 May 20 09:13:25.149418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 8/11] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:25 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:25.160956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-313aee16-f1d8-4a02-88c3-fadf813d9b3c tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d49a1f0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:25.305369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-313aee16-f1d8-4a02-88c3-fadf813d9b3c tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 202 len: 0 microversion: 2.1 time: 0.149202 May 20 09:13:25.306203 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 9/12] 10.222.0.69 () {58 vars in 1253 bytes} [Fri May 20 09:13:25 2022] DELETE /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 20 09:13:25.312520 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0ccb0fee-4542-4ef3-afb2-1dc39991771e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:25.313993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0ccb0fee-4542-4ef3-afb2-1dc39991771e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:25.548209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0ccb0fee-4542-4ef3-afb2-1dc39991771e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:25.562277 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0ccb0fee-4542-4ef3-afb2-1dc39991771e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1214 microversion: 2.1 time: 0.254693 May 20 09:13:25.562862 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 10/13] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:25 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:25.597811 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-faf8c4d5-09e7-4ead-adbd-d488c829c2e5 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d49ab80>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:25.684414 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-faf8c4d5-09e7-4ead-adbd-d488c829c2e5 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.097215 May 20 09:13:25.685461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 11/14] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:25 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:25.779712 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1833472889", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:25.894600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] validate_networks() for [('40febe0e-a58d-4d88-9cb1-48f696a34f45', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:13:26.583436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:26.585410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:26.595199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:26.597239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:26.598227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:26.599019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:26.814785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:26.840807 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a242ec24-da95-45a8-8a40-3c28897f0cc2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1218 microversion: 2.1 time: 0.265577 May 20 09:13:26.844369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 12/15] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:26 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:26.853508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ec3a95db-cbdd-470e-8734-effb6752f666 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d410c10>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:26.912352 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ec3a95db-cbdd-470e-8734-effb6752f666 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.066701 May 20 09:13:26.913530 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 13/16] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:26 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:27.694753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:13:27.695230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:13:27.695791 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:13:27.696297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:13:27.696933 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:13:27.727993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:27.729017 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:27.729989 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:27.730638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:27.767751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for project ed0e52a9d6374123b57759435d43d7aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:27.785020 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for user 992571802b7d426f923e0f0bc41e28de and project ed0e52a9d6374123b57759435d43d7aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:27.817022 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:13:27.829836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:13:27.861001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:27.862457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:27.882289 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:27.882988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:27.886663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:27.887427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:27.966836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bbff50f6-3766-4251-b522-a3bc48e20d9d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.037197 May 20 09:13:27.978583 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 4/17] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:13:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:13:27.993060 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1692e52c-09a6-44e9-8f9b-f17975ead569 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8de28820>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:28.108755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1692e52c-09a6-44e9-8f9b-f17975ead569 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 200 len: 286 microversion: 2.1 time: 0.128504 May 20 09:13:28.114533 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 5/18] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:27 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:28.122278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4e346d81-a070-46f1-b7fe-80889ea25900 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:28.123463 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4e346d81-a070-46f1-b7fe-80889ea25900 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:28.329758 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4e346d81-a070-46f1-b7fe-80889ea25900 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:28.357891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4e346d81-a070-46f1-b7fe-80889ea25900 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1222 microversion: 2.1 time: 0.242208 May 20 09:13:28.358473 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 6/19] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:28 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:28.534718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:28.545644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-026d0d7f-c31a-4b2d-b27a-a6c905a7e1ba tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1218 microversion: 2.1 time: 0.689135 May 20 09:13:28.548945 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 14/20] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:27 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1218 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:28.631440 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1515550131", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:28.741432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] validate_networks() for [('40febe0e-a58d-4d88-9cb1-48f696a34f45', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:13:29.123915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fee2e3c2-7a6d-43ec-9be5-245bda5a5787 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d41b310>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:29.185612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-fee2e3c2-7a6d-43ec-9be5-245bda5a5787 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] HTTP exception thrown: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fee2e3c2-7a6d-43ec-9be5-245bda5a5787 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Request method failure captured: May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 HTTP/1.1 May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1urHYog7AXy2M9NQ7cNUWDuUXJTPSpDkO5ChDDY6UuqYZqH98cUAyXsLkZLTdPtGQC2_7YFy-6DCka-3foX-xEDiRXoVJRncXJk8GAlsJ7bFYDeaCWpHQS-ghPKRxdT4IorMqr8VdlSVJQgFnF9ckLlm3dFpc5HKIvXVPIZNnpu1lw May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:13:29.193870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5b224b67d8641a184a061a1d2373a6c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}] May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a6bfdd7350d244edb8f5b09034c8f4a5 May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '431d7eb8-e0a9-48cc-92e7-337c701b5892'} May 20 09:13:29.195234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. (HTTP 404) (Request-ID: req-d3d80014-47b8-43d8-9d27-310781e8125a) May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.195976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:13:29.196815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 20 09:13:29.197686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fee2e3c2-7a6d-43ec-9be5-245bda5a5787 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Returning 404 to user: Snapshot 431d7eb8-e0a9-48cc-92e7-337c701b5892 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:13:29.198630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fee2e3c2-7a6d-43ec-9be5-245bda5a5787 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892" status: 404 len: 111 microversion: 2.1 time: 0.081346 May 20 09:13:29.199245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 15/21] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:13:29 2022] GET /compute/v2.1/os-snapshots/431d7eb8-e0a9-48cc-92e7-337c701b5892 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:13:29.223754 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-79ec25c1-f9ea-4066-a503-0a9bdb125ed1 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d495f70>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:29.371000 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-79ec25c1-f9ea-4066-a503-0a9bdb125ed1 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261" status: 202 len: 0 microversion: 2.1 time: 0.166848 May 20 09:13:29.372587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 16/22] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:13:29 2022] DELETE /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:13:29.393231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a56cc87e-fe7e-40f7-83da-b5abb0978ba4 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d41b700>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:29.558432 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a56cc87e-fe7e-40f7-83da-b5abb0978ba4 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261" status: 200 len: 345 microversion: 2.1 time: 0.179161 May 20 09:13:29.566821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 17/23] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:13:29 2022] GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:29.575367 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:29.577301 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:29.612226 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:29.614126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:29.615007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:29.617158 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:30.118221 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:30.146525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a98c2d25-3894-4516-9741-8256fbb01ed7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1272 microversion: 2.1 time: 0.574794 May 20 09:13:30.153192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 18/24] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:29 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1272 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:30.582955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-081347b6-6023-48b7-a403-ef79737ad784 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d3710d0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:30.665002 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-081347b6-6023-48b7-a403-ef79737ad784 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] HTTP exception thrown: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-081347b6-6023-48b7-a403-ef79737ad784 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Request method failure captured: May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 HTTP/1.1 May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1urHYog7AXy2M9NQ7cNUWDuUXJTPSpDkO5ChDDY6UuqYZqH98cUAyXsLkZLTdPtGQC2_7YFy-6DCka-3foX-xEDiRXoVJRncXJk8GAlsJ7bFYDeaCWpHQS-ghPKRxdT4IorMqr8VdlSVJQgFnF9ckLlm3dFpc5HKIvXVPIZNnpu1lw May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:13:30.668185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5b224b67d8641a184a061a1d2373a6c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}] May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a6bfdd7350d244edb8f5b09034c8f4a5 May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '07c6fd47-e58e-441f-b467-65525ea64261'} May 20 09:13:30.669577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. (HTTP 404) (Request-ID: req-5604546c-0d92-4d85-ba88-95ceeadf4741) May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.670350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:13:30.671501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 20 09:13:30.672585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-081347b6-6023-48b7-a403-ef79737ad784 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Returning 404 to user: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-081347b6-6023-48b7-a403-ef79737ad784 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261" status: 404 len: 109 microversion: 2.1 time: 0.101328 May 20 09:13:30.673666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 19/25] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:13:30 2022] GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:13:30.694487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-865f584f-f8ed-4bb3-84eb-8b255663f805 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d3b3820>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:30.812010 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-865f584f-f8ed-4bb3-84eb-8b255663f805 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] HTTP exception thrown: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-865f584f-f8ed-4bb3-84eb-8b255663f805 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Request method failure captured: May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 HTTP/1.1 May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1urHYog7AXy2M9NQ7cNUWDuUXJTPSpDkO5ChDDY6UuqYZqH98cUAyXsLkZLTdPtGQC2_7YFy-6DCka-3foX-xEDiRXoVJRncXJk8GAlsJ7bFYDeaCWpHQS-ghPKRxdT4IorMqr8VdlSVJQgFnF9ckLlm3dFpc5HKIvXVPIZNnpu1lw May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:13:30.814288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5b224b67d8641a184a061a1d2373a6c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}] May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a6bfdd7350d244edb8f5b09034c8f4a5 May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '07c6fd47-e58e-441f-b467-65525ea64261'} May 20 09:13:30.815697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. (HTTP 404) (Request-ID: req-389e17a6-073d-4a41-ac80-2f7fe2024db0) May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.816435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 20 09:13:30.817496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 20 09:13:30.819292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.820620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.822722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-865f584f-f8ed-4bb3-84eb-8b255663f805 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Returning 404 to user: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:13:30.823826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-865f584f-f8ed-4bb3-84eb-8b255663f805 tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261" status: 404 len: 109 microversion: 2.1 time: 0.139818 May 20 09:13:30.824532 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 20/26] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:13:30 2022] DELETE /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:13:30.835761 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-909b7003-7ba9-4a87-9d71-e1727a7d5a5b tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Calling method '.version_select at 0x7f7c8d3714c0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:30.899722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-909b7003-7ba9-4a87-9d71-e1727a7d5a5b tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] HTTP exception thrown: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-909b7003-7ba9-4a87-9d71-e1727a7d5a5b tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Request method failure captured: May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 HTTP/1.1 May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1urHYog7AXy2M9NQ7cNUWDuUXJTPSpDkO5ChDDY6UuqYZqH98cUAyXsLkZLTdPtGQC2_7YFy-6DCka-3foX-xEDiRXoVJRncXJk8GAlsJ7bFYDeaCWpHQS-ghPKRxdT4IorMqr8VdlSVJQgFnF9ckLlm3dFpc5HKIvXVPIZNnpu1lw May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:13:30.902779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f5b224b67d8641a184a061a1d2373a6c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f5b224b67d8641a184a061a1d2373a6c"}]}] May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f5b224b67d8641a184a061a1d2373a6c May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-164375850 May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a6bfdd7350d244edb8f5b09034c8f4a5 May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-164375850-project May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '07c6fd47-e58e-441f-b467-65525ea64261'} May 20 09:13:30.904150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. (HTTP 404) (Request-ID: req-8206a050-ef91-461e-b194-d734747adae4) May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.904894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:13:30.905804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 20 09:13:30.912583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. May 20 09:13:30.913890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:13:30.916394 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-909b7003-7ba9-4a87-9d71-e1727a7d5a5b tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] Returning 404 to user: Volume 07c6fd47-e58e-441f-b467-65525ea64261 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:13:30.917428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-909b7003-7ba9-4a87-9d71-e1727a7d5a5b tempest-VolumesSnapshotsTestJSON-164375850 tempest-VolumesSnapshotsTestJSON-164375850-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261" status: 404 len: 109 microversion: 2.1 time: 0.088014 May 20 09:13:30.918528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 21/27] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:13:30 2022] GET /compute/v2.1/os-volumes/07c6fd47-e58e-441f-b467-65525ea64261 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:13:31.174700 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:31.179210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:31.201413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:31.202829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:31.205867 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:31.207947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:31.599388 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:31.614499 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cef27463-b48f-4d64-90ea-0cf67970111b tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1272 microversion: 2.1 time: 0.443668 May 20 09:13:31.617163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 22/28] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:31 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1272 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:32.635137 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:32.636585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:32.674762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:32.690818 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:32.690818 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:32.690818 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:32.960937 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:32.984968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e9fc9d82-04aa-49fb-8416-ae694dee08dd tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1272 microversion: 2.1 time: 0.345324 May 20 09:13:32.985903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 23/29] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:32 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:34.002401 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:34.004087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:34.023865 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:34.027579 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:34.030179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:34.030828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:34.546689 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:34.578748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-72d78510-79aa-418e-85f9-8cb57d4fe71f tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1272 microversion: 2.1 time: 0.577600 May 20 09:13:34.582568 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 24/30] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:33 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1272 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:34.836554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:13:34.837743 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:13:34.838688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:13:34.839912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:13:34.841054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:13:34.859525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:34.862001 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:34.865917 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:34.868041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:34.932037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for project ed0e52a9d6374123b57759435d43d7aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:34.944986 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for user 992571802b7d426f923e0f0bc41e28de and project ed0e52a9d6374123b57759435d43d7aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:34.981999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:13:34.989466 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:13:35.132136 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8298f7ac-8a3f-4d49-80cf-dd4b3da3ad11 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.506485 May 20 09:13:35.133495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 7/31] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:13:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 6508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:13:35.163706 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c264d743-5c2d-45d2-9c6a-f1b70f7a027d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:35.164666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c264d743-5c2d-45d2-9c6a-f1b70f7a027d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:35.518258 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c264d743-5c2d-45d2-9c6a-f1b70f7a027d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:35.548186 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c264d743-5c2d-45d2-9c6a-f1b70f7a027d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1222 microversion: 2.1 time: 0.408298 May 20 09:13:35.556846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 25/32] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:35 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1222 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:35.601299 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:35.601840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:35.618552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:35.620516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:35.623309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:35.628904 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:36.581575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:36.596796 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:36.625171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:36.646595 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:36.651785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:36.659583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:37.078394 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:37.086386 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9ee734fc-1e2c-48f4-b389-42ed69b0d925 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1274 microversion: 2.1 time: 0.516623 May 20 09:13:37.090868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 26/33] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:36 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1274 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:37.138530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:37.192633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d2018ecc-d77b-49e4-a7fe-35511e7ba56e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 1.582485 May 20 09:13:37.205400 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 8/34] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:35 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:38.310930 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9c1b48f3-2412-4246-b1d6-d1e9fd0e1c5d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: .version_select at 0x7f7c8d371a60>, body: {"keypair": {"name": "tempest-keypair-1564569844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEQWPHyK8Eyq117gMzYjxxzcA0ZGcoOI2faH+8/vOVjFPVK07Lz+c+Iq1JUXlBAs7o/8nYOsy0hcKn347jEoHhOQ9czK+mHv7UeFtr+fXDvMQ39d1Nv8qXGuVs904lQZg=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:38.473148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-9c1b48f3-2412-4246-b1d6-d1e9fd0e1c5d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:38.501646 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-9c1b48f3-2412-4246-b1d6-d1e9fd0e1c5d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for user bfaaa367491745708334c5f35331bf76 and project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:38.508827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4c048bf8-c2b9-4498-acfe-398621c762ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'create', calling method: .version_select at 0x7f7c8c2c2f70>, body: {"keypair": {"name": "tempest-keypair-994885927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/O0yu4FtJkun0TwDx3O258UwUjFcx5pl2j6mv+fB5KdNK7z6WfpFLmdepKDgKOVnl4IPkUpJ2VuzSW3GLscQd1fcUSEiiVX7V2vViVqUShY1G2IXD57ZCnWFAmjASXlQ=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:38.620726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-4c048bf8-c2b9-4498-acfe-398621c762ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:38.647404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-4c048bf8-c2b9-4498-acfe-398621c762ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for user a7e574dc676841dea1f23a06c333ff14 and project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:38.663048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9c1b48f3-2412-4246-b1d6-d1e9fd0e1c5d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.428951 May 20 09:13:38.663759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 27/35] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:13:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:38.686499 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:38.687140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:38.742271 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:38.752021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:38.755230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:38.755771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:38.827053 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4c048bf8-c2b9-4498-acfe-398621c762ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.295255 May 20 09:13:38.828448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 9/36] 10.222.0.69 () {62 vars in 1199 bytes} [Fri May 20 09:13:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1297 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 20 09:13:38.842552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:38.849670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:38.881292 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:38.881747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:38.882540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:38.882993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:39.016278 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:39.027960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7ec07b8b-a1b7-4cab-874e-489eabcaa155 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1280 microversion: 2.1 time: 0.345387 May 20 09:13:39.035029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 28/37] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:38 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1280 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:39.996042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f9101fb1-bcb2-4eef-b09d-65d27bb64807 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: .version_select at 0x7f7c8d2e1790>, body: {"keypair": {"name": "tempest-keypair-1867156308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyhtDHrUQrgWd0Ztn1OuYDLJQxJ+8SiyiQHh24OVgcpf4gDbbBSpEi3yBiHV7yqk4EmD/lUZdBYghRYL0tXXjA6lyhEwqD9QyazVk9Ofis6UMri008xoBc6bNvAJ/kYCg=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:40.032572 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-f9101fb1-bcb2-4eef-b09d-65d27bb64807 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:40.049928 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-f9101fb1-bcb2-4eef-b09d-65d27bb64807 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:40.111447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f9101fb1-bcb2-4eef-b09d-65d27bb64807 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.075055 May 20 09:13:40.112495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 29/38] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:13:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:40.117711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:40.126099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:40.143039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:40.143531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:40.144349 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:40.144900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:41.552188 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:41.568676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-581d4793-5703-4ab1-af4a-c8a69254a431 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1280 microversion: 2.1 time: 1.454578 May 20 09:13:41.575983 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 30/39] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:40 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1280 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:41.607551 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:41.633338 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6efb0940-1819-4337-a393-ba0af39bc770 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 2.803544 May 20 09:13:41.639850 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 10/40] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:38 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:42.594559 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:42.617289 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:42.645936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:42.646655 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:42.650651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:42.651360 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:42.656711 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:42.658029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:42.672123 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:42.676029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:42.679641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:42.680358 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:42.802643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:42.835157 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-66623992-04af-44a6-9656-138a135e1a14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1280 microversion: 2.1 time: 0.241397 May 20 09:13:42.838138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 31/41] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:42 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:43.854000 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:43.854788 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:43.872576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:43.873146 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:43.873936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:43.874511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:44.263568 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:44.275308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ecbda65c-b6df-4eaa-aeb6-6c4159de92b4 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1280 microversion: 2.1 time: 0.425118 May 20 09:13:44.284552 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 32/42] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:43 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1280 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:44.907925 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:45.233461 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:45.242537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-161e1f45-759e-441b-9672-f0f26324ea91 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 2.589747 May 20 09:13:45.261642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 11/43] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:42 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 2609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:45.303290 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:45.304164 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:45.317749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:45.326751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:45.332180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:45.332918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:46.260126 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:46.261898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:46.270822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=10 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:46.277278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:46.278713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:46.280835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:46.282589 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:46.378395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=25 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:46.460397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:46.476852 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5767f3a4-929f-44b8-aa31-0394245daf96 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 1.177243 May 20 09:13:46.483833 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 33/44] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:45 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:47.163169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:47.170178 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-e062680d-66ff-4ed6-89b2-9c9237dbbfd4 req-0599e585-5ec7-4e8f-86b5-2612c404febd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e26fcf7-52fb-4640-9eeb-1de9f728cc0b", "tag": "1a09aad3-d3c9-4bd3-b661-5c6b0dcb1927"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:47.183653 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-faf4b07b-d633-4724-a4ad-b7ba6bc6be7d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.916015 May 20 09:13:47.193067 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 12/45] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:46 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:47.202747 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-e062680d-66ff-4ed6-89b2-9c9237dbbfd4 req-0599e585-5ec7-4e8f-86b5-2612c404febd service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:47.204075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-986144654", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb464892-cf71-4d2e-b68f-60163c12a0fe"}], "security_groups": [{"name": "tempest-securitygroup--1539641134"}], "key_name": "tempest-keypair-994885927", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:47.210882 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-e062680d-66ff-4ed6-89b2-9c9237dbbfd4 req-0599e585-5ec7-4e8f-86b5-2612c404febd service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:47.270361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-e062680d-66ff-4ed6-89b2-9c9237dbbfd4 req-0599e585-5ec7-4e8f-86b5-2612c404febd service nova] Creating event network-changed:1a09aad3-d3c9-4bd3-b661-5c6b0dcb1927 for instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b on hv-cinder-83699 May 20 09:13:47.287104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-e062680d-66ff-4ed6-89b2-9c9237dbbfd4 req-0599e585-5ec7-4e8f-86b5-2612c404febd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 20 09:13:47.289603 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:47.292790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:47.296865 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:47.297994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:47.335915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.compute.rpcapi [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 20 09:13:47.337010 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] Releasing lock "compute-rpcapi-router" {{(pid=117980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 20 09:13:47.410048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dc766738-127b-4c73-b916-84fd4b75fcfe None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.814336 May 20 09:13:47.410842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 34/46] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:47.497599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:47.500535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:47.516112 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:47.516969 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:47.519099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:47.531490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:47.783631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] validate_networks() for [('cb464892-cf71-4d2e-b68f-60163c12a0fe', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:13:48.080528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:48.096722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a5b0e831-6ac4-4150-86d7-ab6604ca5aa8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.602867 May 20 09:13:48.106748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 35/47] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:47 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:48.139464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-52520587", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "328df357-f834-447d-8616-ac57cd7979a2"}], "security_groups": [{"name": "tempest-securitygroup--803343854"}], "key_name": "tempest-keypair-1867156308", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:48.704181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=24 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:48.884445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] validate_networks() for [('328df357-f834-447d-8616-ac57cd7979a2', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:13:49.833892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:13:49.834367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:13:49.834810 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:13:49.835217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:13:49.835676 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:13:49.849327 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:49.850381 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:49.853163 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:49.856222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:49.909698 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:49.914692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for user a7e574dc676841dea1f23a06c333ff14 and project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:49.941241 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:13:49.946437 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:13:50.045135 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a10c6e3d-d52f-42e2-8986-1961ee3911d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.859283 May 20 09:13:50.052049 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 13/48] 10.222.0.69 () {62 vars in 1187 bytes} [Fri May 20 09:13:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 20 09:13:50.061799 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:50.062888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:50.063369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=14 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:50.072765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.080931 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.082067 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.082705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.445749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:13:50.446169 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:13:50.446637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:13:50.447042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:13:50.447484 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:13:50.449573 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:50.463403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.464128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.465914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.467217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.495894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=83 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:50.512664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:50.518114 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:50.535824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:13:50.539015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:13:50.646436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7c1ea66b-2b09-4566-844a-adb5b9fc0ddd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.545855 May 20 09:13:50.655741 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 36/49] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:13:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 2556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:13:50.662242 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:50.662848 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:50.701167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.701781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.702628 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.704240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.852217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:50.860582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a041468f-dbde-4d56-8e4a-d9a7299159a0 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.807169 May 20 09:13:50.861175 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 14/50] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:50 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:50.878195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b7f95b44-1627-4322-9d15-daaa643378bc req-1e3fbfbe-283f-42ce-a835-cb95f0d1dc2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97bdede-0305-4f4b-bc04-8b659b1c88ce", "tag": "5dbf97e0-97de-43b0-acce-908bce8975fe"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:50.889903 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b7f95b44-1627-4322-9d15-daaa643378bc req-1e3fbfbe-283f-42ce-a835-cb95f0d1dc2c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.890386 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b7f95b44-1627-4322-9d15-daaa643378bc req-1e3fbfbe-283f-42ce-a835-cb95f0d1dc2c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.913940 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b7f95b44-1627-4322-9d15-daaa643378bc req-1e3fbfbe-283f-42ce-a835-cb95f0d1dc2c service nova] Creating event network-changed:5dbf97e0-97de-43b0-acce-908bce8975fe for instance a97bdede-0305-4f4b-bc04-8b659b1c88ce on hv-cinder-83699 May 20 09:13:50.915570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b7f95b44-1627-4322-9d15-daaa643378bc req-1e3fbfbe-283f-42ce-a835-cb95f0d1dc2c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117981) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 20 09:13:50.916839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.917453 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.918377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.918993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.932164 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.compute.rpcapi [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 20 09:13:50.933693 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117981) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 20 09:13:50.954058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:50.958772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4c7aab82-d0d6-4010-9fce-5eb2bc4cbee6 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090541 May 20 09:13:50.960376 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 15/51] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:50.965993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-609383e9-639e-4ebe-ac62-48c46cd26e3d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.307797 May 20 09:13:50.966658 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:50.967748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 37/52] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:50 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:50.970627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:50.974113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4252079b-8afb-40a3-a2eb-110d6617fb28 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:50.975823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4252079b-8afb-40a3-a2eb-110d6617fb28 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:50.992326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.993909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:50.997517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:50.998094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:51.063856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4252079b-8afb-40a3-a2eb-110d6617fb28 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:51.074898 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4252079b-8afb-40a3-a2eb-110d6617fb28 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1240 microversion: 2.1 time: 0.105516 May 20 09:13:51.075842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 38/53] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:50 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:51.142847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:51.161877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:51.166143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:51.167911 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-99df47f7-5a2b-42e4-9065-639f3baaafcc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1284 microversion: 2.20 time: 0.206348 May 20 09:13:51.182887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 16/54] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:50 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:51.653385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1718712560", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1877e401-d42a-4a52-b633-242e6f958903"}], "security_groups": [{"name": "tempest-securitygroup--974521885"}], "key_name": "tempest-keypair-1564569844", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:51.781307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] validate_networks() for [('1877e401-d42a-4a52-b633-242e6f958903', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:13:51.878160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:51.879418 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:51.886534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:51.891829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:51.892858 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:51.895932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.067969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.077682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4f769c03-fcf6-4a7c-895a-cee994fb1ccc tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.203144 May 20 09:13:52.078271 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 17/55] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:51 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:52.094294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:52.095694 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:52.102104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.102649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.103326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.104270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.251802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:13:52.252434 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:13:52.253168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:13:52.253606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:13:52.254031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:13:52.264480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.265579 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.266384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.266811 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.269424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.281883 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0d6af9d5-9bf7-4853-8d82-4a2d20347992 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.191345 May 20 09:13:52.282935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 18/56] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:52 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:52.285215 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:13:52.289127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:52.289374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for user bfaaa367491745708334c5f35331bf76 and project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:13:52.289979 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:52.297787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.298244 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.299383 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.299828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.301470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:13:52.304073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:13:52.353334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2deb8318-b4d1-4e47-9b6f-7367388ca807 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.705645 May 20 09:13:52.354624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 39/57] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:13:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:13:52.360073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:52.361061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:52.371287 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.372114 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.373035 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:52.373611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:52.414801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.428343 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2f23e05d-2623-4027-a6f5-4bd4b95d4f14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1244 microversion: 2.1 time: 0.144037 May 20 09:13:52.435581 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 19/58] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:52 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1244 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:52.440389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7d3263ef-3147-488e-82d7-c7149b42abba tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:52.440990 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7d3263ef-3147-488e-82d7-c7149b42abba tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:52.454130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.469048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.470911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.472443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d9f54026-e5ed-47a8-b929-e9106e4ee5a3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1284 microversion: 2.20 time: 0.116582 May 20 09:13:52.473097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 40/59] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:52 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:52.555179 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7d3263ef-3147-488e-82d7-c7149b42abba tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:52.562263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7d3263ef-3147-488e-82d7-c7149b42abba tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1238 microversion: 2.1 time: 0.125606 May 20 09:13:52.562975 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 20/60] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:52 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1238 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:53.050072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-6c92489d-5e01-4c31-b6d0-3b38cb57e918 req-ed0b1d91-00e3-430e-9f0d-f727e7eb2efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb33473-a994-427d-9822-3ff769987a56", "tag": "7d1ab808-94ab-41bb-b7aa-8b530eb9862e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:53.068257 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6c92489d-5e01-4c31-b6d0-3b38cb57e918 req-ed0b1d91-00e3-430e-9f0d-f727e7eb2efc service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.070516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6c92489d-5e01-4c31-b6d0-3b38cb57e918 req-ed0b1d91-00e3-430e-9f0d-f727e7eb2efc service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.099084 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:53.099740 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:53.112976 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.119465 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.120610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.121644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.130274 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-6c92489d-5e01-4c31-b6d0-3b38cb57e918 req-ed0b1d91-00e3-430e-9f0d-f727e7eb2efc service nova] Creating event network-changed:7d1ab808-94ab-41bb-b7aa-8b530eb9862e for instance 7fb33473-a994-427d-9822-3ff769987a56 on hv-cinder-83699 May 20 09:13:53.153101 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-6c92489d-5e01-4c31-b6d0-3b38cb57e918 req-ed0b1d91-00e3-430e-9f0d-f727e7eb2efc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104640 May 20 09:13:53.156187 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 41/61] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:13:53.302901 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:53.303813 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:53.317814 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.318625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.320146 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.320876 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.404566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:53.416133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e869272d-3276-424a-9ee5-723301566639 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.323808 May 20 09:13:53.417246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 21/62] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:53 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:53.446657 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:53.447525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:53.463663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.464854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.468864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.469562 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.598947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:53.614696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b290089b-f1cd-4a1c-b1c6-ce36c91cf251 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.315294 May 20 09:13:53.620216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 42/63] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:53 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:53.662095 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:53.662706 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:53.665008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:53.673564 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-244aca2b-7f43-4a60-aa26-0fed7b437f42 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1292 microversion: 2.1 time: 0.231299 May 20 09:13:53.677327 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 22/64] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:53 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1292 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:53.688709 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:53.689673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:53.701938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.702462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.703281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.704670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.708450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.710204 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:53.711875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:53.712467 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.045347 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.063462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.069322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.075190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2d37abf2-7153-48a6-9c3e-119ef15ecf3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1340 microversion: 2.20 time: 0.451354 May 20 09:13:54.076325 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 43/65] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:53 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1340 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:54.357842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.372672 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b0e40bd7-70fe-4ab7-aaab-1559f56627b5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1234 microversion: 2.1 time: 0.692457 May 20 09:13:54.374736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 23/66] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:53 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1234 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:54.434634 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:54.436487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:54.444940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:54.446006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.447474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:54.448219 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.632130 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:54.633058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:54.640167 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:54.641748 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.643919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:54.644570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.811809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.822322 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ba4ffced-345c-47e6-8cfc-f9033d373efb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.194327 May 20 09:13:54.823315 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 24/67] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:54 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:54.828515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:54.829363 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:54.835819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:54.836365 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.837024 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:54.837449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:54.845352 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.856868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2069960d-1b0f-47ba-9572-411f4ca0c4cf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.427004 May 20 09:13:54.858172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 44/68] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:54 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:54.925116 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:54.933184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d7767f56-8ba5-47e8-bae1-9359a6305d23 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1298 microversion: 2.1 time: 0.108613 May 20 09:13:54.933875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 25/69] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:54 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:55.100613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:55.101305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:55.109013 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.109833 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.110748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.111448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.335469 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:55.345280 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:55.348373 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:55.350496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4efb53d5-2afd-4f5f-89ee-172aa97a533d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1338 microversion: 2.20 time: 0.254514 May 20 09:13:55.352752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 45/70] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:55 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:55.392285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:55.392891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:55.405146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.407289 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.408170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.411581 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.505685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:55.516509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a1b3132a-bb7f-474f-8331-47b7be8eaff9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1296 microversion: 2.1 time: 0.128159 May 20 09:13:55.530995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 26/71] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:55 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:55.841756 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:55.843003 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:55.856952 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.858198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.860749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.861215 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.874726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:55.875409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:55.888405 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.889275 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:55.891621 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:55.916595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.210187 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.218568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0a1feeb5-b3cc-4eca-a1f2-b4e32b551b34 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.348273 May 20 09:13:56.219899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 27/72] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:55 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:56.225639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:56.226493 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:56.235692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.236441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.237407 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.238008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.284442 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.293268 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2e61c9bc-fbc0-4feb-a49a-8845a504c55e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.456784 May 20 09:13:56.294404 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 46/73] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:55 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:56.380787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.389404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4a5c0a5b-e10d-419b-90fa-9a8e13b574a5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.167657 May 20 09:13:56.389987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 28/74] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:56 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:56.394835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:56.395481 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:56.401964 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.402409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.403198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.403655 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.458064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-6e6ecd85-348a-4452-a5fd-f14446fa7251 req-42440d4e-da3a-4aa9-9604-90241c891f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e26fcf7-52fb-4640-9eeb-1de9f728cc0b", "name": "network-vif-plugged", "status": "completed", "tag": "1a09aad3-d3c9-4bd3-b661-5c6b0dcb1927"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:13:56.470657 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6e6ecd85-348a-4452-a5fd-f14446fa7251 req-42440d4e-da3a-4aa9-9604-90241c891f8a service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.471293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6e6ecd85-348a-4452-a5fd-f14446fa7251 req-42440d4e-da3a-4aa9-9604-90241c891f8a service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.483571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-6e6ecd85-348a-4452-a5fd-f14446fa7251 req-42440d4e-da3a-4aa9-9604-90241c891f8a service nova] Creating event network-vif-plugged:1a09aad3-d3c9-4bd3-b661-5c6b0dcb1927 for instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b on hv-cinder-83699 May 20 09:13:56.488866 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-6e6ecd85-348a-4452-a5fd-f14446fa7251 req-42440d4e-da3a-4aa9-9604-90241c891f8a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193212 May 20 09:13:56.489450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 47/75] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:13:56.538283 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:56.539035 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:56.546467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.546914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.547700 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:56.548122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:56.549364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.558686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.560419 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.562133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a547fd17-d9cd-477d-b1ff-796033125e6b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.171077 May 20 09:13:56.562978 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 29/76] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:56 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:56.613290 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:56.621239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1a1f1603-9d3b-4ab8-8681-7ef0e1ddc16a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1296 microversion: 2.1 time: 0.087256 May 20 09:13:56.621834 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 48/77] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:56 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:57.236555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:57.236760 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:57.242968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.243434 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.244208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.244644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.317196 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:57.318091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:57.324804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.326146 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.327119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.327848 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.471654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.481671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:13:57.485174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2a047334-fc5e-4056-9fc3-fd20edb65b98 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.252458 May 20 09:13:57.489523 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 30/78] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:57 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:57.499238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:57.500026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:57.511521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.512047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.513085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.513811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.680112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.689747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-97c3d8dd-6ada-48b7-9147-c474c86eafdf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.198819 May 20 09:13:57.690993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 31/79] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:57 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:57.710246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:57.712117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:57.721013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.722860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.723435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.725013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.726174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.733193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aff7adaa-c618-4ce8-89f2-ad61a0f2fb9a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.425826 May 20 09:13:57.736843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 49/80] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:57 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:13:57.752702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:57.753699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:57.765249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.768185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.769223 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:57.770044 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:57.920752 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.930059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.932604 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.934191 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d60def3e-0495-46ad-b43f-0eeca152f96e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.242000 May 20 09:13:57.935132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 32/81] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:57 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:57.979776 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:57.990785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1d693130-9055-45ef-b94d-d4f7d4b330b8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1296 microversion: 2.1 time: 0.252456 May 20 09:13:58.014610 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 50/82] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:57 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1296 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:58.505867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:58.506656 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:58.513371 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:58.513914 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:58.514902 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:58.515446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:58.679519 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:58.711428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:58.713223 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:58.718721 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9257d7fb-86fc-4596-9265-9be771e2f4c5 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.216664 May 20 09:13:58.720752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:58.721124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:58.723115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:58.723838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:58.733993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 33/83] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:58 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:58.755624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:58.756436 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:58.764004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:58.764420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:58.765193 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:58.766954 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:59.034863 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:59.044860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dcbf8160-6fbd-4904-8901-61d743ea90ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.292964 May 20 09:13:59.045956 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 34/84] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:58 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:59.050977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:59.054539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:59.072295 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:59.073104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:59.074174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:59.076665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:59.265664 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:59.278548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:59.280700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:59.283292 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2b66e946-3376-457e-b9fe-2a0c336f3740 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.236147 May 20 09:13:59.284855 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 35/85] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:13:59 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:13:59.290129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:59.290935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:59.298779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:59.312301 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:59.323452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:59.323963 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:59.356049 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:59.363972 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-82d776ec-9217-4abc-8ff8-5be23632964e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.659980 May 20 09:13:59.364555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 51/86] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:58 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:59.433368 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:13:59.442413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-90f35a48-c6c0-49e7-a290-931950d06dee tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1296 microversion: 2.1 time: 0.156270 May 20 09:13:59.443591 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 36/87] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:59 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1296 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:13:59.740278 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:13:59.742341 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:13:59.750118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:59.751838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:13:59.752783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:13:59.753216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.079685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.080890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6fc84046-9444-4748-9ae4-e336dea6c0fb req-0059f39a-f5e0-4e80-89d1-6d4e8b652cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:00.091955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b0b06d17-bb1f-4e6c-b65b-9507f53ff06c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.353269 May 20 09:14:00.093108 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 52/88] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:13:59 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:00.098331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:00.098933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:00.102174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6fc84046-9444-4748-9ae4-e336dea6c0fb req-0059f39a-f5e0-4e80-89d1-6d4e8b652cb4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.102770 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6fc84046-9444-4748-9ae4-e336dea6c0fb req-0059f39a-f5e0-4e80-89d1-6d4e8b652cb4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.105227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.105666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.106499 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.106939 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.115860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6fc84046-9444-4748-9ae4-e336dea6c0fb req-0059f39a-f5e0-4e80-89d1-6d4e8b652cb4 service nova] Creating event network-changed:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:14:00.125011 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6fc84046-9444-4748-9ae4-e336dea6c0fb req-0059f39a-f5e0-4e80-89d1-6d4e8b652cb4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136300 May 20 09:14:00.125620 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 37/89] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:14:00.261846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.269582 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c88e5209-ff7d-4daf-8a56-1fd1db023ab0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.175145 May 20 09:14:00.270360 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 53/90] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:00 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:00.307057 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:00.307761 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:00.313956 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.314530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.315330 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.315758 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.383484 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:00.384535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:00.392557 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.393232 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.394561 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.395485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.476041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.484276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.486004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.487087 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-234d6f01-3250-4737-bffd-0c79edb241ac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.184639 May 20 09:14:00.487819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 38/91] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:00 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:00.492609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:00.493408 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:00.499678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.500055 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.500814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:00.501241 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:00.549064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.556770 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a4589400-d57e-4114-a545-303c6a661296 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.178169 May 20 09:14:00.557508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 54/92] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:00 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:00.638377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:00.646215 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-313fd0ce-3c0c-485e-a248-0a93140f6d42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.157245 May 20 09:14:00.646785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 39/93] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:00 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:01.109462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:01.110068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:01.116445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.116898 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.117658 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.118102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.249966 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:01.258890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6ca108dc-b199-4916-8685-42805c96b159 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.153478 May 20 09:14:01.259811 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 55/94] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:01 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:01.285851 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:01.286411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:01.288389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:01.294269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.295216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.296119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.296620 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.505582 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:01.506198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:01.517788 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.518410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.521338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.522415 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.553487 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:01.586164 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:01.593129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0f52a553-6e46-4558-bdb2-50246414ff8b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.310715 May 20 09:14:01.606332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 40/95] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:01 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:01.613074 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:01.614020 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:01.627672 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.628878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.629677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.631000 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.843096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:01.854809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ab4d9a1a-7d52-4eec-a33c-acdea13f528d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.251608 May 20 09:14:01.857555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 41/96] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:01 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:01.868224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:01.869008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:01.875376 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.875828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.876604 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:01.877664 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:01.984006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:01.998803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:02.000732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:02.005918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cfcec7d7-88b4-475e-b138-8d5103c71da5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.503606 May 20 09:14:02.007454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 56/97] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:01 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:02.040993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:02.052998 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e583bf06-4f17-47d2-8e66-cfbcb79eb2f7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.193348 May 20 09:14:02.053591 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 42/98] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:01 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:02.142641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-54e626df-3bc6-4886-a6d7-eeb8ee68b2e6 req-ed370972-66f7-4bb6-be36-0d92e65a1ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121038e6-7ba5-4d8f-b099-53e27cc913c6", "tag": "10b699e9-683d-4dd6-90dd-b78af5111278"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:02.151521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-54e626df-3bc6-4886-a6d7-eeb8ee68b2e6 req-ed370972-66f7-4bb6-be36-0d92e65a1ce5 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.152120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-54e626df-3bc6-4886-a6d7-eeb8ee68b2e6 req-ed370972-66f7-4bb6-be36-0d92e65a1ce5 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:02.166023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-54e626df-3bc6-4886-a6d7-eeb8ee68b2e6 req-ed370972-66f7-4bb6-be36-0d92e65a1ce5 service nova] Creating event network-changed:10b699e9-683d-4dd6-90dd-b78af5111278 for instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 on hv-cinder-83699 May 20 09:14:02.171844 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-54e626df-3bc6-4886-a6d7-eeb8ee68b2e6 req-ed370972-66f7-4bb6-be36-0d92e65a1ce5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032781 May 20 09:14:02.172740 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 57/99] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:02.279278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:02.280227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:02.295006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.296120 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:02.297591 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.298388 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:02.530656 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:02.540408 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-342db28f-7772-4e59-9589-e4ae32d4aac2 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.266143 May 20 09:14:02.542026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 43/100] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:02 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:02.621038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:02.623007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=14 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:02.627824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:02.629535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:02.637718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.638504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:02.639554 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.640657 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:02.872377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:02.873048 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:02.875014 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=8 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:02.881294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.881738 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:02.882506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:02.882932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.017316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.023142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.026813 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c1cef65f-7c0d-42af-a841-e3addd946a09 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.406673 May 20 09:14:03.027397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 58/101] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:02 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:03.032619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:03.032932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6ec4847f-fbc8-4305-88b0-b4e88c0573e5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.164393 May 20 09:14:03.033335 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:03.034310 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 44/102] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:02 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:03.039445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:03.040077 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.040987 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:03.041801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.070355 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:03.071099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:03.078500 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:03.079166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.079987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:03.080414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.190612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.200391 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.202345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.204173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b3f87308-8045-43db-b040-021d1fdea10b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.175644 May 20 09:14:03.204777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 59/103] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:03 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:03.236622 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.244351 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-53da373e-af84-498e-928d-ebacf2bec58a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.178051 May 20 09:14:03.244921 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 45/104] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:03 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:03.558710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:03.559380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:03.582250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:03.582700 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.583544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:03.583979 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:03.719021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:03.726506 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-36be4dc0-b43c-4d66-bda4-b11d74b24687 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.171916 May 20 09:14:03.727404 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 60/105] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:03 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:04.043388 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:04.044062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:04.050889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:04.051374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:04.052145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:04.052264 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:04.053004 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:04.053198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:04.064805 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:04.065637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:04.066767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:04.067375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:04.925948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:04.937216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-69fcb091-30d3-4679-a3bb-40fbfebdfb50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.889935 May 20 09:14:04.941946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 61/106] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:04 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:04.950517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-19df0f52-daf6-414d-ad3e-4eaba3ae172f req-bf921dc9-7cda-457b-b2fe-174877f6a5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99280ff-b8f3-420b-ba9a-e6e5686de569", "tag": "1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:04.963740 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:04.979794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-da33d76a-32a4-48d8-a5b2-bdcdccf7f0fb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.940323 May 20 09:14:04.983472 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 46/107] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:04 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:05.000525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-19df0f52-daf6-414d-ad3e-4eaba3ae172f req-bf921dc9-7cda-457b-b2fe-174877f6a5ea service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.001258 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-19df0f52-daf6-414d-ad3e-4eaba3ae172f req-bf921dc9-7cda-457b-b2fe-174877f6a5ea service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.004569 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:05.007792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:05.031094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.031568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.036211 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.038047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.060616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-19df0f52-daf6-414d-ad3e-4eaba3ae172f req-bf921dc9-7cda-457b-b2fe-174877f6a5ea service nova] Creating event network-changed:1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05 for instance e99280ff-b8f3-420b-ba9a-e6e5686de569 on hv-cinder-83699 May 20 09:14:05.080352 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-19df0f52-daf6-414d-ad3e-4eaba3ae172f req-bf921dc9-7cda-457b-b2fe-174877f6a5ea service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136899 May 20 09:14:05.082641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 62/108] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:05.091889 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:05.093721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:05.103802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.112685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.113725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.114942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.423247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:05.442959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-62c24bcf-b292-47a9-a14e-3daab6092321 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.358612 May 20 09:14:05.454290 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 63/109] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:05 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:05.460500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-c8849ec3-9a88-4296-a2af-64a51058d69c req-645d0c39-9183-4cc1-b75c-07f2a4fbd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97bdede-0305-4f4b-bc04-8b659b1c88ce", "name": "network-vif-plugged", "status": "completed", "tag": "5dbf97e0-97de-43b0-acce-908bce8975fe"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:05.474965 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c8849ec3-9a88-4296-a2af-64a51058d69c req-645d0c39-9183-4cc1-b75c-07f2a4fbd5a4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.475732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c8849ec3-9a88-4296-a2af-64a51058d69c req-645d0c39-9183-4cc1-b75c-07f2a4fbd5a4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.487784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-c8849ec3-9a88-4296-a2af-64a51058d69c req-645d0c39-9183-4cc1-b75c-07f2a4fbd5a4 service nova] Creating event network-vif-plugged:5dbf97e0-97de-43b0-acce-908bce8975fe for instance a97bdede-0305-4f4b-bc04-8b659b1c88ce on hv-cinder-83699 May 20 09:14:05.493596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-c8849ec3-9a88-4296-a2af-64a51058d69c req-645d0c39-9183-4cc1-b75c-07f2a4fbd5a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037364 May 20 09:14:05.494272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 64/110] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:05.500454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:05.501246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:05.509055 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.509501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.510726 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.511154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.653263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:05.661879 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-484ec94f-ec69-4999-9ea6-1720ba30f17c tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.166130 May 20 09:14:05.662467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 65/111] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:05 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:05.702742 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:05.710668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:05.712156 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:05.713276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b8089c25-e020-404e-b8f7-ed30aaaab4af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.727596 May 20 09:14:05.713800 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 47/112] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:04 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:05.959231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:05.960244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:05.968624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.969059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:05.969802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:05.970218 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.003543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:06.004244 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:06.010543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.011078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.011961 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.012491 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.016619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:06.150534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:06.158744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d0d1ae1f-6936-4417-a247-3a55a365d4f6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.159043 May 20 09:14:06.159495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 48/113] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:05 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:06.329149 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:06.336782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-77b6a883-368b-4ac7-bf37-769b7e6c4b8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.383866 May 20 09:14:06.337361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 66/114] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:05 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:06.461980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:06.462981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:06.475169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.475920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.476997 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.477713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.680501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:06.681322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:06.698202 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.698966 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.701336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.704311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.864007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:06.873037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6db87b04-771a-46c4-896d-81d8c8bf6c9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.415749 May 20 09:14:06.873620 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 49/115] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:06 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:06.884135 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:06.886624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:06.897068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.897710 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:06.898547 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:06.898973 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.004667 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:07.022548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-58d2be5b-b2c1-4759-9a35-fc66138ea37e tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.347212 May 20 09:14:07.030621 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 67/116] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:06 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:07.160661 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:07.177936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:07.179033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:07.189195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:07.190994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:07.191334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.191978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.193369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.193582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4824cbaf-3f3d-4308-9280-124d03546d70 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.315940 May 20 09:14:07.194114 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.194965 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 50/117] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:06 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:07.353881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:07.354759 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:07.355537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:07.362097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e33d2f46-91ac-4d8f-b06b-473d2b0ae47e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.188211 May 20 09:14:07.362669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 68/118] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:07 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:07.363634 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.364136 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.364814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.365397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.500936 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:07.508831 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0ce2b3be-dfd5-4094-998e-c3218ef745e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.158386 May 20 09:14:07.509404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 51/119] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:07 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:07.509923 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-4782e802-8b92-4f2d-af21-b8cda24f180f req-47606254-8acd-4200-b924-8deb1427e6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb33473-a994-427d-9822-3ff769987a56", "name": "network-vif-plugged", "status": "completed", "tag": "7d1ab808-94ab-41bb-b7aa-8b530eb9862e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:07.518488 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4782e802-8b92-4f2d-af21-b8cda24f180f req-47606254-8acd-4200-b924-8deb1427e6db service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.518923 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4782e802-8b92-4f2d-af21-b8cda24f180f req-47606254-8acd-4200-b924-8deb1427e6db service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.530897 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-4782e802-8b92-4f2d-af21-b8cda24f180f req-47606254-8acd-4200-b924-8deb1427e6db service nova] Creating event network-vif-plugged:7d1ab808-94ab-41bb-b7aa-8b530eb9862e for instance 7fb33473-a994-427d-9822-3ff769987a56 on hv-cinder-83699 May 20 09:14:07.535823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-4782e802-8b92-4f2d-af21-b8cda24f180f req-47606254-8acd-4200-b924-8deb1427e6db service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029468 May 20 09:14:07.536419 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 69/120] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:14:07.892431 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:07.893043 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:07.900121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.900579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:07.901337 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:07.901794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.035646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.044705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0de905b3-bb27-4816-b492-be141e326c34 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.156862 May 20 09:14:08.045277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 52/121] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:07 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:08.047835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:08.048685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:08.055240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.055718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.056469 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.056900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.189459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.196980 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cef50f90-393c-49e8-a678-5943463d8e30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.153392 May 20 09:14:08.199743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 70/122] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:08 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:08.211885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:08.212539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:08.214367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:08.220028 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.220475 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.221239 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.221667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.372209 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.378259 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:08.378857 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:08.380801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.381248 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:08.382353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.383420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3ffef3e7-b8b4-4250-80af-38fefb0f7238 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.175399 May 20 09:14:08.384142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 53/123] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:08 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:08.386222 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.386650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.387480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.387907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.529356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.529656 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-11f42753-fbcd-4510-93bb-091be6ca8a9e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.155329 May 20 09:14:08.530254 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 71/124] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:08 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:08.532960 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:08.533750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:08.539948 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.540423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.541181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:08.541610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:08.680007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:08.689240 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c35e2212-2a0f-44f3-ab6a-b5e5f125f9c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.167206 May 20 09:14:08.689804 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 54/125] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:08 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:09.061944 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:09.062549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:09.068819 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.069268 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.070023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.070451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.200784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:09.212942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c9d1c5b8-5a91-4fb1-9396-0d60d240fa88 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.154753 May 20 09:14:09.213651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 72/126] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:09 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:09.217638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:09.218853 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:09.225278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.226034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.226941 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.227693 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.358320 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:09.366250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d61275a6-2837-4520-bed9-2e0b098d1664 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.156320 May 20 09:14:09.366785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 55/127] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:09 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:09.404678 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:09.405286 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:09.412628 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.413060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.413820 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.414250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.546370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:09.547050 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:09.553174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.553612 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.554381 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.554817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.556686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:09.565804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:09.567520 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:09.568624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-21de32fb-7b7a-4a11-a6cb-5bb01b11ca19 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.169876 May 20 09:14:09.569144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 73/128] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:09 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:09.697752 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:09.705669 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-43497ff7-a0f3-4995-84a1-3556d72806d3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.163152 May 20 09:14:09.706190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:09.706335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 56/129] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:09 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:09.706793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:09.713125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.713568 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:09.714319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:09.714744 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.000798 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.008942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cf63bd87-742e-45e4-892b-1b56d5fae29b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.306544 May 20 09:14:10.009509 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 74/130] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:09 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:10.232119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:10.232813 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:10.240954 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.241548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.242544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.243111 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.372563 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.380584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a0720d3d-89d1-4cc2-bd41-11d9a490cc83 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.153911 May 20 09:14:10.381154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 57/131] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:10 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:10.383609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:10.384488 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:10.390920 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.391501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.392263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.392692 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.529486 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.531737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:10.538115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6dfbc0a9-01fa-4111-82ce-437139ae2312 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.158705 May 20 09:14:10.538660 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 75/132] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:10 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:10.589197 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:10.590172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:10.601176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.601894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.603022 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.603689 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.722064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:10.722687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:10.729281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.729721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.730468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:10.730887 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:10.734599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.742668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.744242 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.745329 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d0a93444-5694-4eb4-83fb-8e1ddc98b719 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.162155 May 20 09:14:10.745888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 58/133] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:10 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:10.864479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:10.872437 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-972fa996-5bd5-4e61-b417-edd398a2f5c3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.154189 May 20 09:14:10.872976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 76/134] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:10 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:11.030360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:11.031442 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:11.041462 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.042196 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.043487 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.044201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.181225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:11.189360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8fe1d499-9882-4264-ac6d-51781d65b213 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.165892 May 20 09:14:11.190044 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 59/135] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:11 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:11.397664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:11.398269 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:11.408193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.408193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.408193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.408193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.537617 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:11.545156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-afc06ecf-e913-4acc-9a97-10ca73632b9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.151386 May 20 09:14:11.554263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 77/136] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:11 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:11.554829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:11.555516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:11.562046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.562482 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.563316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.563742 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.702409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:11.711515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f6a7a384-a72e-49b6-8299-b0ea6ca5feaf tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.160558 May 20 09:14:11.721553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 60/137] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:11 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:11.763543 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:11.764228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:11.770372 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.770804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.771580 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.772159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.889403 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:11.890031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:11.896428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.896868 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.897614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:11.898044 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:11.904598 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:11.912814 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:11.914267 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:11.915396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f648a3e6-b6fa-4c09-a62f-3265b6ab67ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.156167 May 20 09:14:11.915952 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 78/138] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:11 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:12.028200 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:12.035765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b9ef4318-ca25-4a6d-808c-f7cda4edffb2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.150316 May 20 09:14:12.036335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 61/139] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:11 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:12.210796 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:12.211785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:12.221954 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.222720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.224020 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.224686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.357862 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:12.365786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c4269283-3218-4b9c-815f-b7bf734928c8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.161730 May 20 09:14:12.366317 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 79/140] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:12 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:12.563842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:12.564413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:12.570930 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.571419 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.572167 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.572594 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.709982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:12.719730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fa6d9742-be40-4371-ae96-ca5c14c429f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.160201 May 20 09:14:12.720295 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 62/141] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:12 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:12.728774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:12.729379 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:12.736070 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.736511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.737259 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.737707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.869376 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:12.881126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6daaf7af-9f5d-479f-bf27-2b3dd2ef3c33 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1314 microversion: 2.1 time: 0.156020 May 20 09:14:12.881894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 80/142] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:12 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:12.935363 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:12.936253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:12.945002 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.945628 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:12.946703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:12.947311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.052625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:13.053226 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:13.059675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.060119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.060874 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.061295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.086088 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:13.094214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:13.095721 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:13.096811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b24b1aab-f455-49fb-83af-5661b6ba8749 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.167105 May 20 09:14:13.097410 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 63/143] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:12 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:13.202097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:13.209679 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a58ddbad-db68-44f9-bb1a-1f56c3ff604d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.160952 May 20 09:14:13.210220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 81/144] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:13 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:13.385513 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:13.386304 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:13.394230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.395008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.395980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.396906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.592610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:13.596763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:13.604864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4cbb0dbe-d27e-4f90-90db-6d6e6a2040f1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.225765 May 20 09:14:13.606039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 64/145] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:13 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:13.687432 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-f8c234ed-4688-4131-b0d0-3182d70aa61f req-0e39a181-7ba5-4afc-bba7-8861f08ad379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121038e6-7ba5-4d8f-b099-53e27cc913c6", "name": "network-vif-plugged", "status": "completed", "tag": "10b699e9-683d-4dd6-90dd-b78af5111278"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:13.696301 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-f8c234ed-4688-4131-b0d0-3182d70aa61f req-0e39a181-7ba5-4afc-bba7-8861f08ad379 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.697010 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-f8c234ed-4688-4131-b0d0-3182d70aa61f req-0e39a181-7ba5-4afc-bba7-8861f08ad379 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.708676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-f8c234ed-4688-4131-b0d0-3182d70aa61f req-0e39a181-7ba5-4afc-bba7-8861f08ad379 service nova] Creating event network-vif-plugged:10b699e9-683d-4dd6-90dd-b78af5111278 for instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 on hv-cinder-83699 May 20 09:14:13.714651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-f8c234ed-4688-4131-b0d0-3182d70aa61f req-0e39a181-7ba5-4afc-bba7-8861f08ad379 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030356 May 20 09:14:13.715775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 82/146] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:13.738579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:13.739658 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:13.747751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.748867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.750152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.751728 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.901437 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:13.902326 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:13.914767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.915575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.916674 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:13.917627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:13.971481 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:13.979086 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f53ad674-b686-4284-8bdf-fb9bd9a69d50 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.245895 May 20 09:14:13.979691 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 65/147] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:13 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:14.070591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:14.079390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6f97ce72-1ec6-4bf5-9ad5-5dcb2a2b8277 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1501 microversion: 2.1 time: 0.182802 May 20 09:14:14.079973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 83/148] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:13 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:14.115638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:14.116394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:14.124433 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:14.125057 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:14.125908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:14.126466 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:14.226512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:14.227110 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:14.234716 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:14.235475 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:14.236505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:14.237201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:14.305910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:14.318649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:14.320359 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:14.322488 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-60a65ab1-b8b0-49dc-b6ce-d3c1a4d2bd08 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.211757 May 20 09:14:14.323346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 66/149] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:14 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:14.462358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:14.465651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c842ab29-b2d4-4696-9626-e1b0c9337284 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.242878 May 20 09:14:14.474742 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 84/150] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:14 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:14.621811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:14.622479 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:14.628647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:14.629129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:14.629898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:14.630349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:14.780884 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:14.791407 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-29cff407-7791-45bd-afed-d728bfe8a95b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.173238 May 20 09:14:14.793445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 67/151] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:14 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:14.998001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:14.999063 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:15.006240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.006699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.007563 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.007998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.139526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:15.147511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-44d72400-4dcc-4e1b-9a82-a2cd12829351 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.153905 May 20 09:14:15.148083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 85/152] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:14 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:15.342160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:15.342837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:15.349345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.349834 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.350580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.351006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.483859 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:15.484550 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:15.494701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.498657 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.501494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.502454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.508621 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:15.519370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:15.520990 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:15.522373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8c6a24c3-6d03-414a-ae00-9a434bd3701b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.185132 May 20 09:14:15.529098 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 68/153] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:15 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:15.609214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d277db8-e578-4147-9c7a-5807846c4a90"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:15.610581 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:15.617148 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.617887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.618784 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.619365 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.746052 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:15.764094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3a8d2781-b575-44f2-bee1-461634baf3f8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.279588 May 20 09:14:15.767248 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 86/154] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:15 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:15.810077 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:15.810674 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:15.817857 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.818295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.819228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:15.819659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:15.954713 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:15.962331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-27de8632-39db-458c-9103-5d38430e25ae tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.156230 May 20 09:14:15.963351 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 87/155] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:15 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:16.167453 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:16.168065 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:16.174529 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.175206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.176183 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.176772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.310106 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:16.317703 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fdc2a84a-19aa-438e-a68d-b3bd37441cd8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.156107 May 20 09:14:16.318361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 88/156] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:16 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:16.542212 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:16.543244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:16.549587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.550103 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.550982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.551508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.687222 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:16.715193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:16.716819 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:16.717967 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b4ff38bc-4beb-4365-85e5-80d4e9fbc8f0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.181321 May 20 09:14:16.718546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 89/157] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:16 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:14:16.781323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:16.781968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:16.788211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.788663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.789427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.789859 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.925869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:16.933830 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1100465e-2dc4-42cf-9d99-ec08730808e7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.156438 May 20 09:14:16.934382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 90/158] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:16 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:16.979500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:16.980218 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:16.986494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.987090 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:16.987993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:16.988496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:17.126125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:17.133995 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1fccf6fe-4767-46c1-823c-86057de65d8b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.158507 May 20 09:14:17.134619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 91/159] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:16 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:17.336802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:17.338098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:17.344462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:17.344901 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:17.345834 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:17.346267 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:17.489470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:17.496880 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-74cbec9c-a3c2-41ac-971a-b614b2c354b9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.165281 May 20 09:14:17.497453 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 92/160] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:17 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:17.736487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:17.737118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:17.743725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:17.744219 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:17.744953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:17.745380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:17.748167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:17.890615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:17.899680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:17.901696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:17.903483 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-46a45441-11a6-490c-89fa-2954cf0c293a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.170942 May 20 09:14:17.904029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 93/161] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:17 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:14:17.949867 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:17.950468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:17.956532 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:17.956969 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:17.957704 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:17.958125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:18.090006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:18.097733 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-faacb5e4-250d-452f-9550-42d113a69e66 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.151686 May 20 09:14:18.098363 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 94/162] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:17 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:18.152181 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:18.152729 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:18.159112 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:18.159626 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:18.160387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:18.160820 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:18.290790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:18.299035 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f53a7709-08df-482b-8e7f-2fc0a7a78dd4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.151569 May 20 09:14:18.299722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 95/163] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:18 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:18.514429 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:18.515059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:18.521358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:18.521802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:18.522553 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:18.523132 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:18.781691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:18.790671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e7c7cf0b-4456-4a90-962f-6ac9e13c426d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.280557 May 20 09:14:18.797643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2573022d-a979-45eb-9aa1-5f4661eb443d tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "POST /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.194049 May 20 09:14:18.799805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 69/165] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:14:15 2022] POST /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b/os-volume_attachments => generated 194 bytes in 3197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:14:18.800974 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 96/165] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:18 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:18.816897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1094803883", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "networks": [{"uuid": "1b0a1a59-4f0d-4801-acdf-9aa54ef17cad"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:18.871796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] validate_networks() for [('1b0a1a59-4f0d-4801-acdf-9aa54ef17cad', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:14:18.921391 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:18.921767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:18.934900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:18.935544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:18.936412 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:18.937440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.087958 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.097349 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.099234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.100909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d15964c7-297b-4132-8a6e-37a0eea9a881 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.183580 May 20 09:14:19.101828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 97/166] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:18 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:14:19.115404 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:19.116750 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:19.123424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.123971 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.124969 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.125493 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.312439 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.320532 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a654785c-516b-4a37-a289-5c005abcbc98 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1322 microversion: 2.1 time: 0.209800 May 20 09:14:19.321255 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 98/167] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:19 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:19.326032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:19.326955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:19.332872 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.333313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.334073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.334504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.363353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:14:19.363880 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:14:19.364364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:14:19.364825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:14:19.365283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:14:19.374680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.375160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.376042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.376473 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.394844 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Getting quotas for project 7264062888b544cfb7fbc74cc87f386f. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:14:19.398974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Getting quotas for user 712133b246c94438b94c1f865dca1be9 and project 7264062888b544cfb7fbc74cc87f386f. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:14:19.410291 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:14:19.412814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:14:19.463172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.465677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-232c6e61-8067-4411-b0ec-7d551e1555ee tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652764 May 20 09:14:19.466654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 70/168] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:14:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:14:19.477829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-162f2151-f0cd-49b6-ad17-ca0fe9835ed7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.155284 May 20 09:14:19.478661 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 99/169] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:19 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:19.478788 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e64370bb-6efb-47be-8092-3e8c8836f3f7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:19.479326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e64370bb-6efb-47be-8092-3e8c8836f3f7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:19.533386 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e64370bb-6efb-47be-8092-3e8c8836f3f7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.540869 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e64370bb-6efb-47be-8092-3e8c8836f3f7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1214 microversion: 2.1 time: 0.067883 May 20 09:14:19.541462 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 71/170] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:19 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:19.809118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:19.809934 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:19.816629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.817147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.818052 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:19.818549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:19.974485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:19.982279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0120ab6d-d759-4d35-bbb1-64a6b8ded7f0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.177330 May 20 09:14:19.983029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 100/171] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:19 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:20.120316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:20.121526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:20.123086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-acf1b22d-e6eb-4051-b077-470bacd5f069 req-33b7e4bf-3dc4-4dfc-a683-f3065309916c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99280ff-b8f3-420b-ba9a-e6e5686de569", "name": "network-vif-plugged", "status": "completed", "tag": "1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:20.129550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.129974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.130898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.131552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.132198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-acf1b22d-e6eb-4051-b077-470bacd5f069 req-33b7e4bf-3dc4-4dfc-a683-f3065309916c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.132610 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-acf1b22d-e6eb-4051-b077-470bacd5f069 req-33b7e4bf-3dc4-4dfc-a683-f3065309916c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.145641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-acf1b22d-e6eb-4051-b077-470bacd5f069 req-33b7e4bf-3dc4-4dfc-a683-f3065309916c service nova] Creating event network-vif-plugged:1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05 for instance e99280ff-b8f3-420b-ba9a-e6e5686de569 on hv-cinder-83699 May 20 09:14:20.152075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-acf1b22d-e6eb-4051-b077-470bacd5f069 req-33b7e4bf-3dc4-4dfc-a683-f3065309916c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 May 20 09:14:20.153648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 101/172] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:20.339172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:20.340378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:20.361654 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.362992 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.365480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.366178 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.591884 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:20.605352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:20.606912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:20.608867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-afbc902d-de29-4980-94ba-7501652b2d93 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.493645 May 20 09:14:20.611838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:20.612991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 72/173] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:20 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:20.620190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9e04cc20-0501-4130-92fc-1c39f16146e1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1516 microversion: 2.1 time: 0.285724 May 20 09:14:20.620763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 102/174] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:20 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:20.621389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:20.622148 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:20.630229 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.631227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.632039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:20.633410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:20.637864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.637864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.641781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.642230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.642995 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.643823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.706684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:20.715655 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8edb65a9-d21b-422d-b454-6373af51c1f2 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1218 microversion: 2.1 time: 0.093489 May 20 09:14:20.716558 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 103/175] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:20 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:20.721665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:20.722795 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:20.732960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.733774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.734718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.735152 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.798693 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:20.807237 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-de763dd1-e952-4404-8bbc-1e889149ec96 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1365 microversion: 2.1 time: 0.191100 May 20 09:14:20.808040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 73/176] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:20 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:20.815606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lazy-loading 'flavor' on Instance uuid 7fb33473-a994-427d-9822-3ff769987a56 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:14:20.937801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bbe0240c-c5eb-4ee3-a804-1ced7ae0a031 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56/action" status: 200 len: 32 microversion: 2.1 time: 0.219861 May 20 09:14:20.938396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 104/177] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:14:20 2022] POST /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:14:20.947374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:20.947976 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:20.954081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.954521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.955281 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:20.955699 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:20.999777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:21.000744 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:21.007938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.008671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.009596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.010166 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.152690 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.160364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6365a7bb-f52f-4b04-8af9-809322fe0d6c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.165109 May 20 09:14:21.161224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 105/178] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:20 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:21.258066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.269140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-afc5e866-6620-4a2c-b3a5-876456a5832b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.325465 May 20 09:14:21.270069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 74/179] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:20 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:21.632309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:21.632879 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:21.639467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.639909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.640670 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.641097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.733144 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:21.733712 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:21.740461 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.740921 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.741675 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.742253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.772355 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.781455 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.786443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.787663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f89f8d27-2586-48b0-b149-45950ea28b57 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.159566 May 20 09:14:21.789635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 106/180] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:21 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:21.816063 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.824762 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dbae58c1-a3d1-4f93-bc55-224fa6499a7d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1210 microversion: 2.1 time: 0.095580 May 20 09:14:21.825772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 75/181] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:21 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:21.835175 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:21.835175 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:21.835772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.836212 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.836991 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:21.837402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:21.973074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:21.993648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d507ea53-4405-4cc6-baea-2131e25497ea tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1555 microversion: 2.1 time: 0.157531 May 20 09:14:21.994325 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 107/182] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:21 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:22.013483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:22.014502 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:22.025354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.027626 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.030577 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.032251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.172514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-66f5036f-120b-4f1d-b111-4bb85f7c6e20 req-10f5e3e2-fda0-47a2-bdd9-d41ecafdec01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "name": "network-vif-plugged", "status": "completed", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:22.181968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-66f5036f-120b-4f1d-b111-4bb85f7c6e20 req-10f5e3e2-fda0-47a2-bdd9-d41ecafdec01 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.182736 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-66f5036f-120b-4f1d-b111-4bb85f7c6e20 req-10f5e3e2-fda0-47a2-bdd9-d41ecafdec01 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.198019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-66f5036f-120b-4f1d-b111-4bb85f7c6e20 req-10f5e3e2-fda0-47a2-bdd9-d41ecafdec01 service nova] Creating event network-vif-plugged:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:14:22.204295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-66f5036f-120b-4f1d-b111-4bb85f7c6e20 req-10f5e3e2-fda0-47a2-bdd9-d41ecafdec01 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035719 May 20 09:14:22.205201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 108/183] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:14:22.210554 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:22.211375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:22.218273 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.218413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c9d1433c-f04a-48be-ba24-ed2553be5a2e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209063 May 20 09:14:22.218809 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.218935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 76/184] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:14:22 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:22.219767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.220893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.223305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:22.286046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:22.286708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:22.293792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.294242 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.295736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.296264 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.423462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:22.431729 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9c2c9ba7-b83a-48db-b78a-1c062fff4167 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.225452 May 20 09:14:22.432475 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 109/185] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:22 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:22.589492 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:22.599367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-daced3df-3d82-4089-8c97-b8af0d162964 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.317071 May 20 09:14:22.599957 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 77/186] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:22 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:22.809368 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:22.810251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:22.817073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.817716 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.818540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.819034 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.842355 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:22.843068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:22.849348 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.849799 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.853857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:22.854357 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:22.995835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:23.004607 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:23.006149 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:23.007556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-01e6c335-00e6-4515-8cd0-2dd448f5b040 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.203789 May 20 09:14:23.008138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 110/187] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:22 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:23.037510 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:23.057289 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-69f6e481-da8b-442e-a6ce-b7fe4c969bf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1266 microversion: 2.1 time: 0.218966 May 20 09:14:23.059380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 78/188] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:22 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:23.449397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:23.450004 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:23.457721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:23.458168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:23.458943 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:23.459419 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:23.616617 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:23.617224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:23.626955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:23.627820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:23.629625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:23.630315 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:23.938821 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:23.946768 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ef0f36ca-fbcb-46e9-afa7-87cd53f85f35 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.334032 May 20 09:14:23.947666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 79/189] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:23 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:23.962463 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6c03c4ce-6bf9-42ee-80e7-39b1213d4077 req-c2fd174c-97a9-4f83-b82f-4dbfd45258a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121038e6-7ba5-4d8f-b099-53e27cc913c6", "tag": "10b699e9-683d-4dd6-90dd-b78af5111278"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:23.971838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6c03c4ce-6bf9-42ee-80e7-39b1213d4077 req-c2fd174c-97a9-4f83-b82f-4dbfd45258a6 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:23.972271 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6c03c4ce-6bf9-42ee-80e7-39b1213d4077 req-c2fd174c-97a9-4f83-b82f-4dbfd45258a6 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:23.986119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6c03c4ce-6bf9-42ee-80e7-39b1213d4077 req-c2fd174c-97a9-4f83-b82f-4dbfd45258a6 service nova] Creating event network-changed:10b699e9-683d-4dd6-90dd-b78af5111278 for instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 on hv-cinder-83699 May 20 09:14:23.988661 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:23.992504 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6c03c4ce-6bf9-42ee-80e7-39b1213d4077 req-c2fd174c-97a9-4f83-b82f-4dbfd45258a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 May 20 09:14:23.993331 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 80/190] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:24.001402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5de33c5e-6db9-4655-9e19-2bc0aecc2bf5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1363 microversion: 2.1 time: 0.553845 May 20 09:14:24.003930 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 111/191] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:23 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:24.027165 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:24.027970 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:24.034937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:24.046168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:24.049722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:24.050170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:24.080009 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:24.081945 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:24.094994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:24.095690 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:24.096675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:24.097282 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:24.215517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:24.224900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cd1a5800-1e97-498e-8f08-b4ecf1ddc1fd tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1274 microversion: 2.1 time: 0.153497 May 20 09:14:24.235985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 112/192] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:24 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:24.263214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:24.271696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:24.273531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:24.274982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b2506639-6242-4122-b69d-0e8284b1043b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.252459 May 20 09:14:24.275764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 81/193] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:24 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:24.964106 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:24.964979 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:24.975593 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:24.976276 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:24.981978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:24.982414 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.019745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:25.020789 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:25.030673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.031121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.031920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.032364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.192837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:25.195502 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:25.205612 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0b7a5ff1-cb88-4728-976c-d48976839809 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1549 microversion: 2.1 time: 0.190197 May 20 09:14:25.206625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 82/194] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:25 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:25.226248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:25.226948 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:25.235895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.236416 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.238018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.238507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.280879 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:25.291982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f8b2e27e-b7d1-4817-8636-9b03bf773f14 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.331840 May 20 09:14:25.299318 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 113/195] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:24 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:25.304252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:25.305495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:25.318311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.319387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.320490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.321119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.370337 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6ee3ee63-6684-4b98-babf-58fb9548a45d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150367 May 20 09:14:25.377381 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 83/196] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:14:25 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:25.377987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:25.389751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:25.396136 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.396579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.397351 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:25.397803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:25.487480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:25.499165 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ccfa0f4c-22e0-4c91-9c14-9db20d8fb581 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1284 microversion: 2.1 time: 0.198691 May 20 09:14:25.500109 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 114/197] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:25 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:25.735803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:25.748725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:25.756450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:25.757651 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-04f953a7-57b2-48b8-859b-c47dc9b4a038 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.385428 May 20 09:14:25.772779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 84/198] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:25 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:26.309073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:26.309686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:26.315903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.316334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.317091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.317732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.453940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:26.462648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8dc1fae9-75bc-49e2-89f4-ace9688d21c1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.157329 May 20 09:14:26.463804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 115/199] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:26 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:26.516889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:26.517635 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:26.524687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.525139 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.525905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.526335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.674569 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-a230d75a-6d90-44d7-a94c-954cf5bfb66e req-5ff96003-46eb-43dc-ab98-2bd975029df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99280ff-b8f3-420b-ba9a-e6e5686de569", "tag": "1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:26.683755 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-a230d75a-6d90-44d7-a94c-954cf5bfb66e req-5ff96003-46eb-43dc-ab98-2bd975029df3 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.684544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-a230d75a-6d90-44d7-a94c-954cf5bfb66e req-5ff96003-46eb-43dc-ab98-2bd975029df3 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.699011 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-a230d75a-6d90-44d7-a94c-954cf5bfb66e req-5ff96003-46eb-43dc-ab98-2bd975029df3 service nova] Creating event network-changed:1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05 for instance e99280ff-b8f3-420b-ba9a-e6e5686de569 on hv-cinder-83699 May 20 09:14:26.704202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:26.705347 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-a230d75a-6d90-44d7-a94c-954cf5bfb66e req-5ff96003-46eb-43dc-ab98-2bd975029df3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034875 May 20 09:14:26.705965 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 116/200] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:26.715010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-84717c50-4b12-4286-a330-6e29a3c62cc3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.202017 May 20 09:14:26.718027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 85/201] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:26 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:26.782031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:26.782719 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:26.791883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.792322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.793075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:26.793494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:26.927681 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:26.936364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:26.937960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:26.939377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3e0593b7-f335-44c8-be21-b60fdd469e29 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.161824 May 20 09:14:26.940043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 117/202] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:26 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:27.479892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:27.480501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:27.486963 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:27.487526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:27.488294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:27.488727 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:27.630069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:27.637872 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e2adef13-d928-4cf4-907d-801b3ed5aaec tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.162040 May 20 09:14:27.638434 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 86/203] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:27 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:27.732432 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:27.733038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:27.739500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:27.739931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:27.740678 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:27.741096 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:27.870716 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:27.878612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-823dfd8b-0344-4fdc-917e-c8a8e24ea1a6 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.150158 May 20 09:14:27.879199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 118/204] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:27 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:27.961397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:27.962562 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:27.972896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:27.973640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:27.974885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:27.975667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:28.117069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:28.125549 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:28.127050 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:28.128180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b14c6684-8194-4fc3-a192-721d6a45f7ca tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.173463 May 20 09:14:28.128764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 87/205] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:27 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:28.654160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:28.654870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:28.671694 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:28.672156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:28.672908 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:28.673334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:28.811773 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:28.819523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1e441545-ba53-46df-8097-d94f7fd0a05d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.169075 May 20 09:14:28.820125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 119/206] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:28 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:28.900258 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:28.901305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:28.909744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:28.910184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:28.910931 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:28.911385 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:29.046075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:29.054053 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ae8ceaee-a085-4c31-9377-571132902102 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.160805 May 20 09:14:29.054867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 88/207] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:28 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:29.146039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:29.146885 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:29.153531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:29.153968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:29.155001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:29.155446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:29.295736 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:29.303985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:29.305470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:29.306573 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cbcac886-0e8d-4c68-b871-8e843b28a0d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.164550 May 20 09:14:29.307141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 120/208] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:29 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:29.837061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:29.837744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:29.839909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:29.840609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=8 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:29.846813 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:29.847389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:29.848751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:29.849994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:29.991574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:29.999642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a33af6e7-1233-43eb-ab8c-07646e64dcf7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.167052 May 20 09:14:30.000216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 89/209] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:29 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:30.071213 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:30.071823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:30.074761 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:30.080779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:30.081252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:30.082010 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:30.082441 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:30.220233 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:30.227947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-00685fea-7ec0-4772-900f-7d7f9d15795e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.161155 May 20 09:14:30.228529 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 121/210] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:30 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:30.324623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:30.325257 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:30.331560 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:30.332056 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:30.332832 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:30.333241 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:30.462729 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:30.472096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:30.474144 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:30.475377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8d24f7f2-3982-4f95-ba57-72978a8cb2c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.154727 May 20 09:14:30.476017 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 90/211] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:30 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:31.016281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:31.016941 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:31.023528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:31.024322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:31.025086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:31.025520 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:31.158117 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:31.165802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0eec8bee-60ea-4d92-b6fd-4edb91debc45 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.153480 May 20 09:14:31.166345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 122/212] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:31 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:31.245043 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:31.245618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:31.252611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:31.253389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:31.254150 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:31.254572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:31.393085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:31.402266 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-09058552-f4cd-42a0-9b56-ff3490eb7409 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.161031 May 20 09:14:31.411303 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 91/213] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:31 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:31.493305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:31.494083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:31.500342 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:31.500783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:31.501519 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:31.501936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:31.653704 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:31.661710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:31.663198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:31.664361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-78b5d48c-f12d-4796-bf02-2f0c2e8be38d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.175113 May 20 09:14:31.664917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 123/214] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:31 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:32.182432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:32.183145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:32.190234 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:32.190680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:32.191453 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:32.191919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:32.417907 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:32.419180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:32.420308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:32.426571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:32.427219 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:32.428300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:32.428801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:32.440398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8c0dd1f6-7eea-455b-848a-b3a386b7117a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.260375 May 20 09:14:32.442131 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 92/215] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:32 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:32.683399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:32.684009 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:32.690852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:32.691330 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:32.692091 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:32.692692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:32.795342 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:32.803998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b2c740c7-53f8-467d-a99f-6f7c35fd2299 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.388724 May 20 09:14:32.804839 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 124/216] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:32 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:32.849531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:32.859422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:32.861341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:32.863006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6307069e-ce31-4594-858f-c69aa238b9e5 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1406 microversion: 2.20 time: 0.184757 May 20 09:14:32.864202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 93/217] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:32 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:33.197297 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:33.197981 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:33.206966 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.207993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.209343 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.210724 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.251356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:14:33.283823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:33.336325 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-3d2fba38-dbca-46ad-9c7e-09c2b4fecf96 req-8d4a19b0-d855-49ab-a90b-25a7aa567c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025af0dd-4c95-4946-b62c-402f7f570ad7", "tag": "bbb019e5-d966-4665-acdc-10074ccea14b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:33.347878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-3d2fba38-dbca-46ad-9c7e-09c2b4fecf96 req-8d4a19b0-d855-49ab-a90b-25a7aa567c9d service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.348625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-3d2fba38-dbca-46ad-9c7e-09c2b4fecf96 req-8d4a19b0-d855-49ab-a90b-25a7aa567c9d service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.367819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-3d2fba38-dbca-46ad-9c7e-09c2b4fecf96 req-8d4a19b0-d855-49ab-a90b-25a7aa567c9d service nova] Creating event network-changed:bbb019e5-d966-4665-acdc-10074ccea14b for instance 025af0dd-4c95-4946-b62c-402f7f570ad7 on hv-cinder-83699 May 20 09:14:33.372712 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-3d2fba38-dbca-46ad-9c7e-09c2b4fecf96 req-8d4a19b0-d855-49ab-a90b-25a7aa567c9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040274 May 20 09:14:33.373316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 94/218] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:14:33.393896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6e49c996-f9d3-4ea5-bdb6-bde5fa137e25 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 204 len: 0 microversion: 2.1 time: 0.210979 May 20 09:14:33.394703 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 125/219] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:14:33 2022] DELETE /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:14:33.404491 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:33.411130 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:33.414497 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:33.420507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.421699 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.422693 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.423300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.457609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:33.459207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:33.466024 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.466497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.467141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.467850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.599064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:33.611447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3eb4d601-1c0d-41da-ae5c-a3d9aaed77ea tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1553 microversion: 2.1 time: 0.211632 May 20 09:14:33.612226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 95/220] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:33 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:33.640774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:33.650825 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9d7bd56d-0dbb-4f01-b3d8-6e38cccad80c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.197368 May 20 09:14:33.651549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 126/221] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:33 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:33.823910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:33.824560 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:33.831454 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.831892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.832822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.833252 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.882847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:33.883780 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:33.889791 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.890231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.891050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:33.891642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:33.973926 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:33.981530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8875591f-2e89-4e69-82b4-1831eb19d9c8 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.163389 May 20 09:14:33.982414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 96/222] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:33 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:34.024985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:34.033471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:34.035518 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:34.036707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-db08d3e5-f051-4361-a58c-f66ff5e28ff4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1597 microversion: 2.20 time: 0.159031 May 20 09:14:34.037230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 127/223] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:14:33 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:14:34.055704 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:34.056226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:34.062744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:34.063117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:34.063906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:34.064342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:34.143660 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-aff63c85-5547-4f4b-a0e1-9c89a05afbbc tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091911 May 20 09:14:34.144291 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 97/224] 10.222.0.69 () {60 vars in 1315 bytes} [Fri May 20 09:14:34 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:14:34.633527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:34.635012 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:34.646090 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:34.646850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:34.647949 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:34.648530 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:34.674805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:34.675524 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:34.690290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:34.691455 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:34.692195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:34.692817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:34.925955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:34.936156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9161dc2a-256a-4250-ac74-40df935f2e46 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1553 microversion: 2.1 time: 0.307921 May 20 09:14:34.936981 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 128/225] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:34 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:34.972768 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:34.982445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fb564480-03bc-4199-82fa-e3022b0a25a8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.316669 May 20 09:14:34.994571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 98/226] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:34 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:34.999691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:35.000369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:35.006630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:35.007076 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:35.007945 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:35.008272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:35.179425 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:35.188162 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d93df060-5b9a-4f0e-860c-cb04e735086f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.192528 May 20 09:14:35.189050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 129/227] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:34 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:35.421401 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-45bf1efd-6a15-42f3-abbc-f98f94bb75aa req-1eac70a3-609d-4598-acf5-c70201852bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:35.431833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-45bf1efd-6a15-42f3-abbc-f98f94bb75aa req-1eac70a3-609d-4598-acf5-c70201852bf8 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:35.432268 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-45bf1efd-6a15-42f3-abbc-f98f94bb75aa req-1eac70a3-609d-4598-acf5-c70201852bf8 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:35.447307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-45bf1efd-6a15-42f3-abbc-f98f94bb75aa req-1eac70a3-609d-4598-acf5-c70201852bf8 service nova] Creating event network-changed:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:14:35.454230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-45bf1efd-6a15-42f3-abbc-f98f94bb75aa req-1eac70a3-609d-4598-acf5-c70201852bf8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036280 May 20 09:14:35.455395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 99/228] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:35.956414 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:35.957418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:35.970969 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:35.972206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:35.974279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:35.974924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:36.006301 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:36.007873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:36.018916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:36.024172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:36.025146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:36.025724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:36.230112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:36.244394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2bf54422-6ab8-416d-b527-2f0e629f1ea0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.239113 May 20 09:14:36.245255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 100/229] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:35 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:36.259616 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:36.261143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:36.276589 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:36.277033 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:36.277789 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:36.278204 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:36.315104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:36.621711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:36.638032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-992cefe4-e9c3-4601-9f10-f3a0d57b8db9 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1553 microversion: 2.1 time: 0.686423 May 20 09:14:36.656375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 130/230] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:35 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1553 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:36.823290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:36.837306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f1d47f0a-0c9e-4a69-92aa-84ac19d86914 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.590409 May 20 09:14:36.837890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 101/231] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:36 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:37.261601 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:37.262292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:37.269059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.269503 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:37.270291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.270717 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:37.406474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:37.411587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cf137792-5404-466a-bb29-9cb4549a9fc0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.153996 May 20 09:14:37.412177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 131/232] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:37 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:37.474749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-5a007505-33af-4833-a312-f954c5abb562 req-580752b2-c004-43dc-90a3-70dd94b1babb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e26fcf7-52fb-4640-9eeb-1de9f728cc0b", "name": "network-vif-deleted", "tag": "1a09aad3-d3c9-4bd3-b661-5c6b0dcb1927"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:37.484846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5a007505-33af-4833-a312-f954c5abb562 req-580752b2-c004-43dc-90a3-70dd94b1babb service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.485399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5a007505-33af-4833-a312-f954c5abb562 req-580752b2-c004-43dc-90a3-70dd94b1babb service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:37.498621 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-5a007505-33af-4833-a312-f954c5abb562 req-580752b2-c004-43dc-90a3-70dd94b1babb service nova] Creating event network-vif-deleted:1a09aad3-d3c9-4bd3-b661-5c6b0dcb1927 for instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b on hv-cinder-83699 May 20 09:14:37.503749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-5a007505-33af-4833-a312-f954c5abb562 req-580752b2-c004-43dc-90a3-70dd94b1babb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 May 20 09:14:37.504574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 102/233] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:37.655691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:37.656495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:37.665427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.666704 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:37.667636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.668155 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:37.741153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:37.753167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-de470bad-ac48-4041-9625-7900a8e16f30 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1511 microversion: 2.1 time: 0.101206 May 20 09:14:37.753820 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 132/234] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:37 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:37.859036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:37.861297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:37.869805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.870400 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:37.871332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:37.871905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:38.026574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:38.034639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1c427c57-3df7-41d6-b6bb-655e5f2c1213 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.183895 May 20 09:14:38.035417 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 103/235] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:37 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:38.428193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:38.428854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:38.435082 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:38.435573 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:38.436331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:38.436762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:38.567542 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:38.579024 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f207a35a-fc73-465c-b2cc-a8c17ff27315 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.154422 May 20 09:14:38.579696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 133/236] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:38 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:38.770633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:38.771533 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:38.779506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:38.779980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:38.780726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:38.781817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:38.845768 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90438171f42e4d74bd4e73bfb39ac91d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe8cfef0c4aa3a55dccc8f9aaddc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:38.855021 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7a17621c-0169-4291-a948-cacacb3864ad tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 200 len: 1345 microversion: 2.1 time: 0.088314 May 20 09:14:38.855621 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 104/237] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:38 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:39.052204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:39.052821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:39.059136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:39.059639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:39.060394 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:39.060824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:39.211616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:39.219302 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-22237cee-cc94-4b3e-9e78-7faa24989223 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.171023 May 20 09:14:39.219961 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 134/238] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:39 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:39.601270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:39.602132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:39.608706 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:39.609177 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:39.609976 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:39.610470 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:39.752786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:39.760688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ad45fae9-c1d5-4314-8737-aa240acf06eb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.163901 May 20 09:14:39.761225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 105/239] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:39 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:39.877143 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:39.878259 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:39.888617 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:39.889359 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:39.890606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:39.891368 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:39.905407 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] HTTP exception thrown: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Request method failure captured: May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b HTTP/1.1 May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1uwYTO9luvQhINyZDrn7FDueboD08cD_luTJ8KAJEPpQmhuGt496bskOY8TpUJP7XA2TzYgx-fGjxmwf28oOApvXUQ0qQyk7br3J-NwV5-no5hpgpy6oMxze5rxx-7X13kJ7kRIA870APquNdaxfpPx5za3w89X-mkkE2pHh6Eyp2Q May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:14:39.913306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e84fe8cfef0c4aa3a55dccc8f9aaddc9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}] May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: 90438171f42e4d74bd4e73bfb39ac91d May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:39.914676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '6e26fcf7-52fb-4640-9eeb-1de9f728cc0b'} May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:14:39.915491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:39.916878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:39.918038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Returning 404 to user: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:14:39.918038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6415450b-3a85-4874-8c7d-6f796432dda6 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 404 len: 111 microversion: 2.1 time: 0.044148 May 20 09:14:39.918038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 135/240] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:39 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:14:40.032571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:40.033798 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:40.043645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:40.044219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:40.045342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:40.045928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:40.059665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] HTTP exception thrown: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Request method failure captured: May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b/os-volume_attachments HTTP/1.1 May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1uwYTO9luvQhINyZDrn7FDueboD08cD_luTJ8KAJEPpQmhuGt496bskOY8TpUJP7XA2TzYgx-fGjxmwf28oOApvXUQ0qQyk7br3J-NwV5-no5hpgpy6oMxze5rxx-7X13kJ7kRIA870APquNdaxfpPx5za3w89X-mkkE2pHh6Eyp2Q May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:14:40.070307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e84fe8cfef0c4aa3a55dccc8f9aaddc9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}] May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 90438171f42e4d74bd4e73bfb39ac91d May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:40.071774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'server_id': '6e26fcf7-52fb-4640-9eeb-1de9f728cc0b'} May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:14:40.072526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:40.073732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:14:40.075026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Returning 404 to user: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:14:40.075026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2518eec9-7fcd-49ce-b4fb-1e85160d7097 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045946 May 20 09:14:40.075026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 106/241] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:14:40 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:14:40.245363 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:40.245997 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:40.252410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:40.252855 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:40.253627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:40.254054 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:40.385139 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:40.393362 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fb9d5184-3e69-4fe5-8e1c-2a48a9cda7ed tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.160549 May 20 09:14:40.393940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 136/242] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:40 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:40.785677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:40.786285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:40.792623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:40.793077 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:40.793836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:40.794272 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:41.149393 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:41.157147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-62521938-acfc-4610-b1fc-7d0c7ca14a06 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.380643 May 20 09:14:41.157716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 107/243] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:40 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:41.414513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:41.415506 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:41.425889 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:41.426506 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:41.427710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:41.428294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:41.573451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:41.581147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b9651095-5520-4de8-bc16-6e9a51b9405e tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.173097 May 20 09:14:41.581709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 137/244] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:41 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:42.178399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:42.179238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:42.190390 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:42.191140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:42.192451 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:42.193172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:42.333475 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:42.341429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-35d4574e-0199-4d3a-ae02-a1549f7acdb3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.169907 May 20 09:14:42.341994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 108/245] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:42 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:42.601502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:42.602453 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:42.612103 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:42.612691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:42.613953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:42.614526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:42.763756 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:42.771427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3ba85afa-56d7-44b7-b2d1-b1c060471897 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.176849 May 20 09:14:42.772204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 138/246] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:42 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:43.357788 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:43.358403 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:43.373478 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.374397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.375713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.376772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.382786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:43.383302 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:43.390135 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.390772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.392112 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.393069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.413337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] HTTP exception thrown: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Request method failure captured: May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b HTTP/1.1 May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1uwYTO9luvQhINyZDrn7FDueboD08cD_luTJ8KAJEPpQmhuGt496bskOY8TpUJP7XA2TzYgx-fGjxmwf28oOApvXUQ0qQyk7br3J-NwV5-no5hpgpy6oMxze5rxx-7X13kJ7kRIA870APquNdaxfpPx5za3w89X-mkkE2pHh6Eyp2Q May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:14:43.425122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e84fe8cfef0c4aa3a55dccc8f9aaddc9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}] May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: 90438171f42e4d74bd4e73bfb39ac91d May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.426403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '6e26fcf7-52fb-4640-9eeb-1de9f728cc0b'} May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:14:43.427033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.428119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.429304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Returning 404 to user: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:14:43.429304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dbcee2c8-7e1a-46ec-ab76-18da5d47b0d7 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 404 len: 111 microversion: 2.1 time: 0.047957 May 20 09:14:43.429304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 139/247] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:14:43 2022] DELETE /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:14:43.436619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:43.437770 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] [instance: 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:43.445810 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.446603 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.448090 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.448682 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.466180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] HTTP exception thrown: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Request method failure captured: May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b HTTP/1.1 May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1uwYTO9luvQhINyZDrn7FDueboD08cD_luTJ8KAJEPpQmhuGt496bskOY8TpUJP7XA2TzYgx-fGjxmwf28oOApvXUQ0qQyk7br3J-NwV5-no5hpgpy6oMxze5rxx-7X13kJ7kRIA870APquNdaxfpPx5za3w89X-mkkE2pHh6Eyp2Q May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:14:43.468141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e84fe8cfef0c4aa3a55dccc8f9aaddc9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e84fe8cfef0c4aa3a55dccc8f9aaddc9"}]}] May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: e84fe8cfef0c4aa3a55dccc8f9aaddc9 May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859292983 May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: 90438171f42e4d74bd4e73bfb39ac91d May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-DeleteServersTestJSON-1859292983-project May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.469737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '6e26fcf7-52fb-4640-9eeb-1de9f728cc0b'} May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:14:43.470540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. May 20 09:14:43.471892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:43.474086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] Returning 404 to user: Instance 6e26fcf7-52fb-4640-9eeb-1de9f728cc0b could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:14:43.475440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cfe68172-f307-4a54-befe-00cdfd8a4db3 tempest-DeleteServersTestJSON-1859292983 tempest-DeleteServersTestJSON-1859292983-project] 10.222.0.69 "GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b" status: 404 len: 111 microversion: 2.1 time: 0.043961 May 20 09:14:43.487407 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 140/248] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:43 2022] GET /compute/v2.1/servers/6e26fcf7-52fb-4640-9eeb-1de9f728cc0b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:14:43.607006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:43.608753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-73c637dd-f405-4e34-8b36-31b8f1d498c6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.254744 May 20 09:14:43.609830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 109/249] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:43 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:43.789129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:43.789827 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:43.796121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.796564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:43.797471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:43.797748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:44.023079 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:44.032460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-95104261-4a0e-46d5-8e4a-97483fc4a58a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.247273 May 20 09:14:44.033520 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 141/250] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:43 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:44.415070 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-e99dfa7a-c3b8-438a-ae08-048407016887 req-ade437c1-04fd-4b8f-87b6-143e86243377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025af0dd-4c95-4946-b62c-402f7f570ad7", "name": "network-vif-plugged", "status": "completed", "tag": "bbb019e5-d966-4665-acdc-10074ccea14b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:44.423822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-e99dfa7a-c3b8-438a-ae08-048407016887 req-ade437c1-04fd-4b8f-87b6-143e86243377 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:44.424328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-e99dfa7a-c3b8-438a-ae08-048407016887 req-ade437c1-04fd-4b8f-87b6-143e86243377 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:44.436180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-e99dfa7a-c3b8-438a-ae08-048407016887 req-ade437c1-04fd-4b8f-87b6-143e86243377 service nova] Creating event network-vif-plugged:bbb019e5-d966-4665-acdc-10074ccea14b for instance 025af0dd-4c95-4946-b62c-402f7f570ad7 on hv-cinder-83699 May 20 09:14:44.441651 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-e99dfa7a-c3b8-438a-ae08-048407016887 req-ade437c1-04fd-4b8f-87b6-143e86243377 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 May 20 09:14:44.442450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 110/251] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:44.631697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:44.632306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:44.639479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:44.643139 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:44.645255 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:44.647633 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:44.824579 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:44.833335 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-493dabe1-0b17-4d8f-b72a-7789c660a57f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.207886 May 20 09:14:44.834363 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 142/252] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:44 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:45.050884 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:45.051664 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:45.061389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:45.061814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:45.062885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:45.063637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:45.234285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:45.243996 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8402a4a4-79f3-4ed0-9471-2da383b6882d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.197880 May 20 09:14:45.244670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 111/253] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:45 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:45.849835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:45.850416 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:45.856553 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:45.856982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:45.857719 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:45.858141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:45.880020 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:46.018023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:46.027030 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-95ad4a6c-8360-4461-b1ee-aef93597bb6a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.181168 May 20 09:14:46.027844 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 143/254] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:45 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:46.261935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:46.262772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:46.271049 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:46.271560 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:46.272539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:46.273100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:46.432281 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:46.440978 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-aabe71d8-7036-4438-ac4b-fa85834f8367 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1314 microversion: 2.1 time: 0.183707 May 20 09:14:46.443290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 112/255] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:46 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:46.870651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1964130079", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:46.923554 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] validate_networks() for None {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:14:47.046642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:47.047280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:47.055298 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:47.061715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:47.062548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:47.062980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:47.259096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:47.269121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-26626ca2-64e5-44e7-9f91-062d72e997ed tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.226863 May 20 09:14:47.269795 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 113/256] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:47 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:47.314895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:14:47.315307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:14:47.315799 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:14:47.316237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:14:47.316634 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:14:47.326855 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:47.327282 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:47.328504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:47.328638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:47.345386 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Getting quotas for project 98d3bea8a0a8490b95320500190332a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:14:47.349294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Getting quotas for user f2de40a4164f4460a55c8c5b13c34328 and project 98d3bea8a0a8490b95320500190332a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:14:47.360331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:14:47.362668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:14:47.425940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cb3260d2-7340-4a47-ae7a-bdde045e11d9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558830 May 20 09:14:47.426869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 144/257] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:14:47.437661 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-18465d36-18ff-40db-b40d-c2c8eb3c6ce9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:47.438313 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-18465d36-18ff-40db-b40d-c2c8eb3c6ce9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:47.465960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:47.467129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:47.479694 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:47.480231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:47.481169 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:47.482872 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:47.532941 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-18465d36-18ff-40db-b40d-c2c8eb3c6ce9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:47.541646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-18465d36-18ff-40db-b40d-c2c8eb3c6ce9 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1215 microversion: 2.1 time: 0.108582 May 20 09:14:47.543224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 114/258] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:47 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:47.683786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:47.693422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-99018c06-06c4-464e-a646-264aa75dc414 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1498 microversion: 2.1 time: 0.233715 May 20 09:14:47.705653 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 145/259] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:47 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1498 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:48.195666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:48.196175 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:48.210528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.211195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.212842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.213649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.277444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:14:48.286102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:48.287472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:48.293932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.298022 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.299099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.300312 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.420579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6137636c-9950-4113-8ad1-4bbd878e199c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "DELETE /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 204 len: 0 microversion: 2.1 time: 0.231229 May 20 09:14:48.424436 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 115/260] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:14:48 2022] DELETE /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:14:48.434460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:48.435342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:48.443166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.444106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.445296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.445915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.446935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:48.458526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d0da622c-1dd4-4994-a5e3-48ac5c83f68d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.176302 May 20 09:14:48.458968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 146/261] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:48 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:48.561085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:48.562092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:48.579142 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.580562 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.581508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:48.582680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:48.592650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:48.601824 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0c206d2d-532e-407f-8d5c-bfa2c23f375a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1504 microversion: 2.1 time: 0.172518 May 20 09:14:48.612729 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 116/262] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:48 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:48.668908 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:48.677597 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2b9a9971-2a36-4c37-b7fe-4122085c858f tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1267 microversion: 2.1 time: 0.119874 May 20 09:14:48.683739 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 147/263] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:48 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1267 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:49.475197 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:49.475822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:49.482627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:49.483065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:49.483849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:49.484271 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:49.619990 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:49.621624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:49.623701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:49.628582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-046c34cc-8b61-46fb-8646-00c815ffbca1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.157264 May 20 09:14:49.629568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 117/264] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:49 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:49.637104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:49.638020 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:49.639290 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:49.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:49.694546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:49.695152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:49.701774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:49.702399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:49.703323 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:49.703882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:49.791430 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:49.802596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4edd77ad-cfe4-413d-8d55-9f5f9333cd9a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1275 microversion: 2.1 time: 0.111866 May 20 09:14:49.803546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 118/265] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:49 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:49.819493 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:49.828004 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2a4f7c6f-4433-47a0-b905-9453be7e518d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1504 microversion: 2.1 time: 0.211155 May 20 09:14:49.828582 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 148/266] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:49 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:50.647677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:50.649582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:50.661835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:50.662406 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:50.663441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:50.664228 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:50.684995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:50.825265 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:50.826884 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:50.836281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:50.836956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:50.838128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:50.838779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:50.899422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:50.910801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7f4b7c60-9419-4833-a0c4-3a825a2fcb51 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.268572 May 20 09:14:50.912670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 119/267] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:50 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:50.918560 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:50.920282 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:50.924500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:50.930964 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:50.932035 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:50.932851 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-493afc44-d23d-4157-a491-f068ba384299 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1273 microversion: 2.1 time: 0.116244 May 20 09:14:50.933492 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:50.934365 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:50.938056 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 149/268] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:50 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:51.019138 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:51.031129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8e53299e-70d2-4d90-b5a4-2f0b44a33f6b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 200 len: 1462 microversion: 2.1 time: 0.117063 May 20 09:14:51.031869 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 120/269] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:50 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:51.113729 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-03159604-db80-44e5-a5e1-af009a8836dd req-2b682f7f-a892-401d-84e3-18b307fad504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025af0dd-4c95-4946-b62c-402f7f570ad7", "name": "network-vif-deleted", "tag": "bbb019e5-d966-4665-acdc-10074ccea14b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:51.125799 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-03159604-db80-44e5-a5e1-af009a8836dd req-2b682f7f-a892-401d-84e3-18b307fad504 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:51.126445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-03159604-db80-44e5-a5e1-af009a8836dd req-2b682f7f-a892-401d-84e3-18b307fad504 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:51.144484 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-03159604-db80-44e5-a5e1-af009a8836dd req-2b682f7f-a892-401d-84e3-18b307fad504 service nova] Creating event network-vif-deleted:bbb019e5-d966-4665-acdc-10074ccea14b for instance 025af0dd-4c95-4946-b62c-402f7f570ad7 on hv-cinder-83699 May 20 09:14:51.165081 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-03159604-db80-44e5-a5e1-af009a8836dd req-2b682f7f-a892-401d-84e3-18b307fad504 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054960 May 20 09:14:51.165701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 150/270] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:51.928822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:51.929333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:51.936231 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:51.936666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:51.937431 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:51.937883 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:51.953822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:51.956750 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:51.973236 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:51.973774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:51.975169 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:51.976100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:52.134495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:52.142407 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b954cfe5-eeae-4917-b1f0-1ad5a22b5a56 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.194430 May 20 09:14:52.142982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 151/271] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:51 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:52.148220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-c7b6f103-0d87-4e0f-8674-9c2d01a6feaa req-0f8aa975-5389-4128-96bc-c6f8d3c011b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e9dd6a-5407-4021-b30b-5d9212141228", "tag": "e0f2e94a-d0e8-46c9-bcc4-cc697e406501"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:52.156636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c7b6f103-0d87-4e0f-8674-9c2d01a6feaa req-0f8aa975-5389-4128-96bc-c6f8d3c011b4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:52.157091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c7b6f103-0d87-4e0f-8674-9c2d01a6feaa req-0f8aa975-5389-4128-96bc-c6f8d3c011b4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:52.168837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-c7b6f103-0d87-4e0f-8674-9c2d01a6feaa req-0f8aa975-5389-4128-96bc-c6f8d3c011b4 service nova] Creating event network-changed:e0f2e94a-d0e8-46c9-bcc4-cc697e406501 for instance 87e9dd6a-5407-4021-b30b-5d9212141228 on hv-cinder-83699 May 20 09:14:52.173532 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-c7b6f103-0d87-4e0f-8674-9c2d01a6feaa req-0f8aa975-5389-4128-96bc-c6f8d3c011b4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029036 May 20 09:14:52.174154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 152/272] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:14:52.179237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:52.179415 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:52.179904 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 025af0dd-4c95-4946-b62c-402f7f570ad7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:52.186017 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:52.186455 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:52.187200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:52.187646 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:52.187920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9399c045-4f56-4794-95b2-0a82b3ddefb6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.263098 May 20 09:14:52.188993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 121/273] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:51 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:52.201272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] HTTP exception thrown: Instance 025af0dd-4c95-4946-b62c-402f7f570ad7 could not be found. May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Request method failure captured: May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 HTTP/1.1 May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vpBtNgKjefVrKK1S8bJ5VYGgp4Kgk2zVLGBpS3ssoNEn_JVrYgCGYTheBoBY-F--2IGKeNzwKsnDH6qQQjM997j3xVKjrbGdfmShXD2gEvfsbrO1YrcCBBA8nS24fgPob0VbjlzmdGWfg8R1l2FzM37y_5CUs7UdIalAZGd1s3IxE May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 7264062888b544cfb7fbc74cc87f386f May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesActionsTest-2038882880 May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:14:52.202914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7264062888b544cfb7fbc74cc87f386f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7264062888b544cfb7fbc74cc87f386f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7264062888b544cfb7fbc74cc87f386f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7264062888b544cfb7fbc74cc87f386f"}]}] May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesActionsTest-2038882880 May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 7264062888b544cfb7fbc74cc87f386f May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesActionsTest-2038882880 May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesActionsTest-2038882880-project May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: 712133b246c94438b94c1f865dca1be9 May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesActionsTest-2038882880-project May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 025af0dd-4c95-4946-b62c-402f7f570ad7 could not be found. May 20 09:14:52.204408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '025af0dd-4c95-4946-b62c-402f7f570ad7'} May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025af0dd-4c95-4946-b62c-402f7f570ad7 could not be found. May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:14:52.205291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025af0dd-4c95-4946-b62c-402f7f570ad7 could not be found. May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025af0dd-4c95-4946-b62c-402f7f570ad7 could not be found. May 20 09:14:52.207319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:14:52.208846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Returning 404 to user: Instance 025af0dd-4c95-4946-b62c-402f7f570ad7 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:14:52.208846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-311a5b08-4a77-4842-8c71-e5a72437d1c4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7" status: 404 len: 111 microversion: 2.1 time: 0.029047 May 20 09:14:52.208846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 153/274] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:52 2022] GET /compute/v2.1/servers/025af0dd-4c95-4946-b62c-402f7f570ad7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:14:52.309278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-872289831", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "networks": [{"uuid": "1b0a1a59-4f0d-4801-acdf-9aa54ef17cad"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:14:52.365086 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] validate_networks() for [('1b0a1a59-4f0d-4801-acdf-9aa54ef17cad', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:14:52.818652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:14:52.819097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:14:52.819738 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:14:52.820242 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:14:52.820554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:14:52.838628 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:52.839066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:52.839929 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:52.840403 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:52.858280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Getting quotas for project 7264062888b544cfb7fbc74cc87f386f. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:14:52.862389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Getting quotas for user 712133b246c94438b94c1f865dca1be9 and project 7264062888b544cfb7fbc74cc87f386f. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:14:52.873405 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:14:52.875776 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:14:52.920820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-225b17bd-4567-42d3-b33e-cb2b117d44ca tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615392 May 20 09:14:52.921485 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 122/275] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:14:52.931825 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-069d4144-849a-4502-ab6d-85b3f9ff07cc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:52.932446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-069d4144-849a-4502-ab6d-85b3f9ff07cc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:52.984465 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-069d4144-849a-4502-ab6d-85b3f9ff07cc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:52.991286 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-069d4144-849a-4502-ab6d-85b3f9ff07cc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1213 microversion: 2.1 time: 0.063581 May 20 09:14:52.991836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 154/276] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:52 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:53.160495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:53.161096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:53.167448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:53.167855 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:53.168840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:53.169250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:53.205462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:53.206038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:53.213129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:53.213575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:53.214349 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:53.214774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:53.318852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:53.326598 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-78ffec1a-785c-455b-a41d-8e9a600e62ce tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.170784 May 20 09:14:53.327171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 123/277] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:53 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:53.353732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:53.361400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-89944ab7-9cd0-4a16-a5bd-e4895591a2b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.159780 May 20 09:14:53.362046 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 155/278] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:53 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:14:54.012671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:54.013670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:54.021639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:54.022081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:54.022823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:54.023284 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:54.084108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:54.091603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-10e0b0a8-a087-4941-a56a-9a129c8ed55b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1217 microversion: 2.1 time: 0.085467 May 20 09:14:54.092164 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 124/279] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:54 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:54.347333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:54.348052 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:54.355942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:54.356516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:54.357452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:54.357986 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:54.379168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:54.379894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:54.386752 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:54.387194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:54.387995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:54.388413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:54.487036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:54.494567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e99319fe-26d2-455a-86c5-f1810011231b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.153435 May 20 09:14:54.495502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 156/280] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:54 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:54.520180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:54.528875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-636900ed-5c10-4f14-9f4d-fa806964575e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.154083 May 20 09:14:54.529668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 125/281] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:54 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:55.108778 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:55.109389 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:55.116142 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:55.116584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:55.117765 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:55.118194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:55.182019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:55.191884 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b554adee-7c1e-4358-919b-3ba332cd4ea3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1217 microversion: 2.1 time: 0.087139 May 20 09:14:55.192449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 157/282] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:55 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:55.516248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:55.517248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:55.525042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:55.525509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:55.526309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:55.526741 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:55.549225 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:55.550179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:55.556606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:55.557050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:55.557800 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:55.558229 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:55.661124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:55.669251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-45dfcd22-d587-4033-afb8-823f50c9a49d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.159533 May 20 09:14:55.669853 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 126/283] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:55 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:55.696551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:55.703876 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-07c1cfe7-8c92-4f48-97e9-93461c6501a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.159256 May 20 09:14:55.704446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 158/284] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:55 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:56.208195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:56.208807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:56.215025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:56.215509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:56.216259 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:56.216692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:56.278422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:56.286023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5c83f07f-c183-4816-bc73-813e7cd9077c tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1217 microversion: 2.1 time: 0.081777 May 20 09:14:56.286589 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 127/285] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:56 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:56.689998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:56.690787 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:56.698748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:56.699323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:56.700252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:56.700783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:56.721936 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:56.723140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:56.729915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:56.730362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:56.731104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:56.731565 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:56.835587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:56.843297 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-80d0574c-d577-4245-b58d-2a6bee3d3f7b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.159664 May 20 09:14:56.843865 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 159/286] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:56 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:56.864842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:56.872353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-814c8a57-6c77-4911-a671-1fdcf7f5527e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.155089 May 20 09:14:56.872928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 128/287] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:56 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:57.307210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:57.308250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:57.311345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:57.317967 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:57.318411 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:57.319163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:57.319615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:57.335805 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:57.384102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:57.392222 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-94f5e15e-aa9e-4ed1-8a34-88b8dd1e5cec tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1217 microversion: 2.1 time: 0.091401 May 20 09:14:57.392718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 160/288] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:57 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:57.864071 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:57.864671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:57.871911 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:57.872347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:57.873126 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:57.873550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:57.889361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:57.890662 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:57.897266 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:57.897754 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:57.898858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:57.899285 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:58.018872 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:58.027171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-22fae011-4a92-4bf4-994e-11719a89e4f7 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.168323 May 20 09:14:58.027794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 129/289] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:57 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:58.234535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:58.243173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-15280e64-d47f-456d-a888-4af6bd04785f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.357656 May 20 09:14:58.243784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 161/290] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:57 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:58.418619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:58.419685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:58.428037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:58.428483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:58.429216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:58.429677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:58.494624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:58.503958 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-da969cd7-b2b2-4bb9-99f8-b0e693522983 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1217 microversion: 2.1 time: 0.091975 May 20 09:14:58.504641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 130/291] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:58 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:59.050321 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:59.050918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:59.065545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:59.067424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:59.068456 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:59.068893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:59.200036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:59.207720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fe0c45be-6736-495f-b5b7-b9ff698b579a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.166956 May 20 09:14:59.208295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 162/292] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:59 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:59.260429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:59.261051 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:59.267411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:59.267923 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:59.268682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:59.269112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:59.410745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:59.421676 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-62b8edc2-fb64-4269-b005-e5ac4f4ef9d1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.165224 May 20 09:14:59.422471 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 131/293] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:59 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:14:59.523840 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:14:59.525115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:14:59.533684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:59.534316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:59.535216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:14:59.535770 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:14:59.611883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:14:59.617264 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:14:59.623695 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8d72b48f-c826-4b88-b484-43ed38a73520 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1265 microversion: 2.1 time: 0.106244 May 20 09:14:59.625050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 163/294] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:14:59 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:00.225182 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:00.225850 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:00.232496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.232944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.233714 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.234143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.438982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:00.439970 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:00.446907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.447378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.448133 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.448555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.455353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:00.470016 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-20090eb8-a9c4-433d-b99f-bea5f15df626 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.248814 May 20 09:15:00.477599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 132/295] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:00 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:00.612528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:00.621515 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-85f124f5-0cde-4953-b7f0-a5dc03c33024 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.187283 May 20 09:15:00.622537 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 164/296] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:00 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:00.641647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:00.642580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:00.645844 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-aa143339-cc7a-44fd-ae23-195eb5fd184e req-e6e1d169-bd54-46c5-9451-fd28df40915c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e9dd6a-5407-4021-b30b-5d9212141228", "name": "network-vif-plugged", "status": "completed", "tag": "e0f2e94a-d0e8-46c9-bcc4-cc697e406501"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:00.650217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.650895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.652009 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.652620 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.655099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-aa143339-cc7a-44fd-ae23-195eb5fd184e req-e6e1d169-bd54-46c5-9451-fd28df40915c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:00.655613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-aa143339-cc7a-44fd-ae23-195eb5fd184e req-e6e1d169-bd54-46c5-9451-fd28df40915c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:00.673401 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-aa143339-cc7a-44fd-ae23-195eb5fd184e req-e6e1d169-bd54-46c5-9451-fd28df40915c service nova] Creating event network-vif-plugged:e0f2e94a-d0e8-46c9-bcc4-cc697e406501 for instance 87e9dd6a-5407-4021-b30b-5d9212141228 on hv-cinder-83699 May 20 09:15:00.680540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-aa143339-cc7a-44fd-ae23-195eb5fd184e req-e6e1d169-bd54-46c5-9451-fd28df40915c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038924 May 20 09:15:00.682102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 165/297] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:00.864959 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:00.880076 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dc49ea49-d183-4afd-ba73-92a06d08ac95 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.237912 May 20 09:15:00.880769 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 133/298] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:00 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:01.451631 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-b7cc2c06-f933-47da-86fd-6605522ece54 req-713c4fb0-8a59-4554-b9f1-2f12bbce8f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dbd10f-2b1d-4c58-b6e7-761738db0c0f", "tag": "6d844e13-29b3-4d31-8c99-adb33a126847"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:01.460074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b7cc2c06-f933-47da-86fd-6605522ece54 req-713c4fb0-8a59-4554-b9f1-2f12bbce8f43 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.460501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b7cc2c06-f933-47da-86fd-6605522ece54 req-713c4fb0-8a59-4554-b9f1-2f12bbce8f43 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:01.472684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-b7cc2c06-f933-47da-86fd-6605522ece54 req-713c4fb0-8a59-4554-b9f1-2f12bbce8f43 service nova] Creating event network-changed:6d844e13-29b3-4d31-8c99-adb33a126847 for instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f on hv-cinder-83699 May 20 09:15:01.477817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-b7cc2c06-f933-47da-86fd-6605522ece54 req-713c4fb0-8a59-4554-b9f1-2f12bbce8f43 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031764 May 20 09:15:01.478418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 166/299] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:01.494032 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:01.494647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:01.497156 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:01.505105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.505553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:01.506526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.507101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:01.638934 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:01.639652 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:01.644947 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:01.646116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.646562 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:01.647344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.647773 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:01.653276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8f8e04ec-d9ae-4e01-ad36-d778d97065ac tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1315 microversion: 2.1 time: 0.163035 May 20 09:15:01.653915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 134/300] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:01 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:01.775919 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:01.783683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-41e74d4c-2355-45b5-9c2b-152e663f853a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.148945 May 20 09:15:01.784341 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 167/301] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:01 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:01.905387 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:01.907325 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:01.914567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.915014 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:01.915812 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:01.916247 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.185920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:02.193692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a7597788-e6ce-4dfe-8bd5-a65ecc2aec38 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.298594 May 20 09:15:02.194244 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 135/302] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:01 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:02.672246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:02.672988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:02.679843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:02.679974 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.680988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:02.681246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.800509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:02.801008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:02.808673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:02.809289 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.810046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:02.810627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.833033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:02.840574 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fae9fa2b-faa2-4cad-bc7c-9db930d84d6a tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1464 microversion: 2.1 time: 0.173689 May 20 09:15:02.841153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 168/303] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:02 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:02.849278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:02.869519 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=8 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:02.886239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:02.886738 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:02.897899 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:02.898726 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.899511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:02.900092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:02.933382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:15:02.988114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:02.989199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=8 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:02.995997 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:02.999034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-865d152d-ba3a-42e8-997d-7b159a05bf5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.202391 May 20 09:15:03.001610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 136/304] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:02 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:03.051205 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2363bac6-94dc-4001-9a70-5ccda49b283d tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "DELETE /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 204 len: 0 microversion: 2.1 time: 0.168593 May 20 09:15:03.052038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 169/305] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:15:02 2022] DELETE /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:15:03.063429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:03.065404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:03.072613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:03.073252 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:03.074170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:03.074746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:03.211674 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:03.212362 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:03.218327 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:03.219213 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:03.219516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:03.219935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:03.241472 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:03.248888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8eec64fe-0657-4bc4-be7b-ba6356d1ac1b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1470 microversion: 2.1 time: 0.192246 May 20 09:15:03.249437 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 137/306] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:03 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:03.352955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:03.360643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1ffe4858-3707-494e-90ca-3e6ff6e44de4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.153733 May 20 09:15:03.361236 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 170/307] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:03 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:04.017954 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:04.018600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:04.025222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:04.025673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:04.026436 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:04.026864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:04.165271 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:04.173830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9b42e8a8-f15f-4a4c-b8a7-fb248423dfbc tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.160136 May 20 09:15:04.174579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 138/308] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:04 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:04.265720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:04.266312 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:04.272901 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:04.273613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:04.274359 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:04.274783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:04.377603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:04.378311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:04.384894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:04.385344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:04.386102 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:04.386532 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:04.411134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:04.419147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d1287938-d3c2-4ec8-a54b-65129fa3645b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1470 microversion: 2.1 time: 0.157282 May 20 09:15:04.419781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 171/309] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:04 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:04.513854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:04.521967 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2fa52feb-89ef-4698-b597-db7ecb6941d3 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.148262 May 20 09:15:04.522543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 139/310] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:04 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:05.193268 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:05.193936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:05.201583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:05.202081 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:05.202938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:05.203459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:05.339425 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:05.347128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fd74b979-5988-489a-a0b3-ea2264d0fcc5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.158858 May 20 09:15:05.347723 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 172/311] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:05 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:05.440643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:05.441305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:05.450282 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:05.450880 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:05.451969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:05.452505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:05.539195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:05.539840 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:05.546232 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:05.546845 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:05.547431 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:05.547856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:05.599871 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:05.608250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-974db294-94e1-48e7-8406-7c766db22b8b tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1470 microversion: 2.1 time: 0.174195 May 20 09:15:05.608846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 140/312] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:05 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:05.676691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:05.684632 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4c99d327-c821-4ced-975e-26eef7204869 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.149347 May 20 09:15:05.685198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 173/313] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:05 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:06.363663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:06.364185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:06.370587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:06.371028 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:06.371820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:06.372247 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:06.533605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:06.545922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fd9c7c58-98ee-44ab-930a-df5f354b1a90 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.186058 May 20 09:15:06.546770 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 141/314] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:06 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:06.625725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:06.626193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:06.632724 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:06.633192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:06.633917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:06.634344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:06.701958 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:06.702865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:06.710218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:06.711031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:06.712061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:06.712700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:06.847638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:06.855300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-076ba966-574e-4f3d-b19d-d9fbb79ad4c5 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1470 microversion: 2.1 time: 0.233592 May 20 09:15:06.856126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 174/315] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:06 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:06.926697 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:06.936272 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1087348d-a64f-46ea-a90c-a2f62d48a405 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.238202 May 20 09:15:06.937339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 142/316] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:06 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:07.234337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-c3f81ccb-1e60-4f13-ac44-50429204eaae req-bbc36bd3-f819-4821-81f5-c6c03e3cb070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e9dd6a-5407-4021-b30b-5d9212141228", "name": "network-vif-deleted", "tag": "e0f2e94a-d0e8-46c9-bcc4-cc697e406501"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:07.244892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c3f81ccb-1e60-4f13-ac44-50429204eaae req-bbc36bd3-f819-4821-81f5-c6c03e3cb070 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.245331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c3f81ccb-1e60-4f13-ac44-50429204eaae req-bbc36bd3-f819-4821-81f5-c6c03e3cb070 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:07.263909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-c3f81ccb-1e60-4f13-ac44-50429204eaae req-bbc36bd3-f819-4821-81f5-c6c03e3cb070 service nova] Creating event network-vif-deleted:e0f2e94a-d0e8-46c9-bcc4-cc697e406501 for instance 87e9dd6a-5407-4021-b30b-5d9212141228 on hv-cinder-83699 May 20 09:15:07.272989 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-c3f81ccb-1e60-4f13-ac44-50429204eaae req-bbc36bd3-f819-4821-81f5-c6c03e3cb070 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042392 May 20 09:15:07.274360 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 175/317] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:07.563556 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:07.564175 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:07.571027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.571503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:07.572267 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.572736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:07.705913 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:07.718845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5004f1a0-53b7-4459-af47-04b635e24a3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.158996 May 20 09:15:07.719682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 143/318] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:07 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:07.873791 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:07.874477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:07.881100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.881538 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:07.882288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.882709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:07.947551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2de40a4164f4460a55c8c5b13c34328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d3bea8a0a8490b95320500190332a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:07.953687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:07.954255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:07.955451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fdbb3e97-202b-4af4-a2e4-d69aa097d00e tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 200 len: 1428 microversion: 2.1 time: 0.086104 May 20 09:15:07.956128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 176/319] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:07 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:07.960838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.961293 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:07.962009 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:07.962670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:08.096611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:08.104641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-58fb270c-a370-4d06-be59-9df6986cf3fc tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.154838 May 20 09:15:08.105328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 144/320] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:07 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:08.737662 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:08.738309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:08.745475 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:08.746081 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:08.746858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:08.747405 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:08.887970 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:08.895814 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a492c503-0ae8-4fd5-bcb5-3c359eec4050 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.162601 May 20 09:15:08.896461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 177/321] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:08 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:08.972651 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:08.973263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] [instance: 87e9dd6a-5407-4021-b30b-5d9212141228] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:08.979901 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:08.980345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:08.981100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:08.981528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:08.995344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] HTTP exception thrown: Instance 87e9dd6a-5407-4021-b30b-5d9212141228 could not be found. May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Request method failure captured: May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 HTTP/1.1 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1wFJHAJJJow5aUjE9-Y-8NBdwqXa0WkMG_bi5gRxfJ0QrhzSPOS6H2dCAswOqW4HrRYTMtIIsvxIDm-MOG7bnSaFl7TIq38QmDgAPKe2vvMrrIiDllWUwy0VvnWsRy6VQe4C8P0Jz5E2IugtvwRm3lk5FesQ2Wohtj185vRzXPFC04 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 98d3bea8a0a8490b95320500190332a2 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-1653808659 May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:15:08.997630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/98d3bea8a0a8490b95320500190332a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_98d3bea8a0a8490b95320500190332a2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98d3bea8a0a8490b95320500190332a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/98d3bea8a0a8490b95320500190332a2"}]}] May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-1653808659 May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 98d3bea8a0a8490b95320500190332a2 May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-1653808659 May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-1653808659-project May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: f2de40a4164f4460a55c8c5b13c34328 May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-1653808659-project May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 87e9dd6a-5407-4021-b30b-5d9212141228 could not be found. May 20 09:15:08.999027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '87e9dd6a-5407-4021-b30b-5d9212141228'} May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e9dd6a-5407-4021-b30b-5d9212141228 could not be found. May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:15:08.999937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e9dd6a-5407-4021-b30b-5d9212141228 could not be found. May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e9dd6a-5407-4021-b30b-5d9212141228 could not be found. May 20 09:15:09.001344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:09.002520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] Returning 404 to user: Instance 87e9dd6a-5407-4021-b30b-5d9212141228 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:15:09.002520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6b18af8e-dc1b-4454-b5db-be1bc3f60647 tempest-VolumesNegativeTest-1653808659 tempest-VolumesNegativeTest-1653808659-project] 10.222.0.69 "GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228" status: 404 len: 111 microversion: 2.1 time: 0.030554 May 20 09:15:09.002520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 145/322] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:08 2022] GET /compute/v2.1/servers/87e9dd6a-5407-4021-b30b-5d9212141228 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:15:09.121609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:09.122242 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:09.128456 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:09.128883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:09.129642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:09.130070 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:09.265611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:09.273531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-daff681d-ddf3-4c3e-b736-243f6025ea6f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.155462 May 20 09:15:09.274104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 178/323] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:09 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:09.918418 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:09.919339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:09.926772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:09.927218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:09.928429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:09.928856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:10.080886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:10.088639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6a81ce19-3f09-4499-ac55-2d924fc9597d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.176610 May 20 09:15:10.089308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 146/324] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:09 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:10.290199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:10.290804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:10.297064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:10.297500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:10.298245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:10.298697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:10.428706 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:10.436671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-82a849ba-09b9-474b-a4ed-ea194ad2c52b tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.150322 May 20 09:15:10.437247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 179/325] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:10 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:11.105507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:11.106142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:11.112537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:11.112983 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:11.113750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:11.114177 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:11.281738 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:11.290709 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-70a7efed-5d2f-4368-b21f-01c65dcb57ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.189216 May 20 09:15:11.301204 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 147/326] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:11 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:11.454247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:11.455089 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:11.463092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:11.463092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:11.463482 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:11.463731 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:11.620981 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:11.623584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:11.638072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bdfcfb35-6a8b-4336-ab43-2549f77b6961 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.187605 May 20 09:15:11.638707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 180/327] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:11 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:12.309336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:12.310158 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:12.319503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:12.332571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:12.334735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:12.335309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:12.478071 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:12.485920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fa4f7831-9080-4d7f-97c8-0554e7fe965e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.181261 May 20 09:15:12.486489 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 148/328] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:12 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:12.654965 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:12.656752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:12.665186 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:12.665818 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:12.666827 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:12.667549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:12.760561 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-f8cce75c-57b4-48b7-8b25-392351e13ae9 req-4f9ea384-6fc7-40cc-b911-b18e327f3b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dbd10f-2b1d-4c58-b6e7-761738db0c0f", "name": "network-vif-plugged", "status": "completed", "tag": "6d844e13-29b3-4d31-8c99-adb33a126847"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:12.771538 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f8cce75c-57b4-48b7-8b25-392351e13ae9 req-4f9ea384-6fc7-40cc-b911-b18e327f3b5f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:12.772268 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f8cce75c-57b4-48b7-8b25-392351e13ae9 req-4f9ea384-6fc7-40cc-b911-b18e327f3b5f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:12.791712 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-f8cce75c-57b4-48b7-8b25-392351e13ae9 req-4f9ea384-6fc7-40cc-b911-b18e327f3b5f service nova] Creating event network-vif-plugged:6d844e13-29b3-4d31-8c99-adb33a126847 for instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f on hv-cinder-83699 May 20 09:15:12.805220 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-f8cce75c-57b4-48b7-8b25-392351e13ae9 req-4f9ea384-6fc7-40cc-b911-b18e327f3b5f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048804 May 20 09:15:12.806682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 149/329] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:12.974295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:12.983789 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8f6e20ae-f9f3-45a4-bde1-c518ab538f00 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.333182 May 20 09:15:12.985468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 181/330] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:12 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:13.505696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:13.507023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:13.514296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:13.514840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:13.515881 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:13.516580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:13.726514 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:13.753105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b8e7fc8d-6d64-4446-8a24-9585a35ed919 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1522 microversion: 2.1 time: 0.252578 May 20 09:15:13.753919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 150/331] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:13 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:14.002075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:14.002766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:14.009689 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:14.010391 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:14.011180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:14.011635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:14.153575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:14.163771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1923f2ea-ba4d-411e-a08b-e3c8b3d42cf4 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.166008 May 20 09:15:14.164469 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 182/332] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:13 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:14.770303 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:14.770896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:14.780176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:14.780953 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:14.781856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:14.782286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:14.917917 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:14.925505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0bc59dee-c8c6-4cd0-89d5-d14849993831 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1502 microversion: 2.1 time: 0.159370 May 20 09:15:14.926075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 151/333] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:14 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:14.941536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:14.942019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:14.948452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:14.948903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:14.949663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:14.950093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:15.085130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:15.092926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5fdb00ee-6a75-45a7-8144-82bac7866225 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1515 microversion: 2.1 time: 0.155395 May 20 09:15:15.093500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 183/334] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:14 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:15.183122 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:15.184365 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:15.201715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:15.202869 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:15.203913 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:15.204570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:15.397044 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:15.405577 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-01d5cbba-7ce4-4e92-819d-caad82e3259a tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1313 microversion: 2.1 time: 0.228135 May 20 09:15:15.406076 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 152/335] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:15 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:16.422052 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:16.422664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:16.429021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:16.429464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:16.430217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:16.430662 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:16.526258 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:16.527247 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:16.534245 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:16.534684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:16.535506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:16.536003 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:16.559019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lazy-loading 'flavor' on Instance uuid a97bdede-0305-4f4b-bc04-8b659b1c88ce {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:15:16.574315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:16.581867 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-73ad60f3-9fee-4f18-8d3d-4c95845464a1 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1497 microversion: 2.1 time: 0.163721 May 20 09:15:16.582422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 184/336] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:16 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:16.632756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:16.681467 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d6a2a06e-b10b-428e-ab39-71edf8869a76 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/action" status: 200 len: 32 microversion: 2.1 time: 0.159729 May 20 09:15:16.687420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 153/337] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:15:16 2022] POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 20 09:15:16.693526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:16.694137 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:16.700462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:16.700899 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:16.701677 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:16.702104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:16.856956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:16.864537 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-01e086b9-d97a-4e68-b2ed-eedbec73e2b0 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.175124 May 20 09:15:16.865096 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 185/338] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:16 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:17.887852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:17.888989 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:17.901141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:17.901863 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:17.903101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:17.903856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:18.040424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:18.052479 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9efa6cbc-8627-4a2c-a093-cc1fc3167cab tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.172645 May 20 09:15:18.053278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 154/339] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:17 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:19.073364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:19.074344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:19.084985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:19.085723 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:19.086962 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:19.087737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:19.226162 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:19.235039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d89e011f-84f6-42a5-ae74-655021591b3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.168246 May 20 09:15:19.235683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 186/340] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:19 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:19.890700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:19.891192 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:19.899695 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:19.900132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:19.900894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:19.901333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:19.934765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:15:20.015441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a9c6f49-a34c-4c68-a8c5-d208ba1c0b72 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 204 len: 0 microversion: 2.1 time: 0.128648 May 20 09:15:20.016059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 155/341] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:15:19 2022] DELETE /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:15:20.025364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:20.025985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:20.032239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:20.032684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:20.033443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:20.033875 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:20.174413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:20.182357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-283fabb5-e89e-4e91-a0af-af487d9c149d tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1503 microversion: 2.1 time: 0.161123 May 20 09:15:20.182924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 187/342] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:20 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:20.253208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:20.253899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:20.260980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:20.261510 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:20.262349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:20.262786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:20.415148 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:20.423368 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fa8bc49a-c94f-4eec-92b5-5e80d4d5a3bf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.174449 May 20 09:15:20.423938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 156/343] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:20 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:21.200032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:21.200647 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:21.207147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:21.207620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:21.208488 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:21.208914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:21.346774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:21.355181 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d72e9b4d-bcf6-4b80-9772-a9641bc35903 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1503 microversion: 2.1 time: 0.159001 May 20 09:15:21.356082 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 188/344] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:21 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:21.442445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:21.443037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:21.450128 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:21.450570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:21.451368 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:21.451789 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:21.591633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:21.599800 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9e03920c-4631-474d-9a5c-78db14e8bedf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.161373 May 20 09:15:21.600487 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 157/345] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:21 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:22.356441 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-c5cb1631-d240-4de3-a2c2-8abc3abddea2 req-a1601bb0-1ddf-4f79-b9fd-a450e2aff462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dbd10f-2b1d-4c58-b6e7-761738db0c0f", "name": "network-vif-deleted", "tag": "6d844e13-29b3-4d31-8c99-adb33a126847"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:22.364887 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c5cb1631-d240-4de3-a2c2-8abc3abddea2 req-a1601bb0-1ddf-4f79-b9fd-a450e2aff462 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.365334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c5cb1631-d240-4de3-a2c2-8abc3abddea2 req-a1601bb0-1ddf-4f79-b9fd-a450e2aff462 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.373270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:22.374192 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:22.379675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-c5cb1631-d240-4de3-a2c2-8abc3abddea2 req-a1601bb0-1ddf-4f79-b9fd-a450e2aff462 service nova] Creating event network-vif-deleted:6d844e13-29b3-4d31-8c99-adb33a126847 for instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f on hv-cinder-83699 May 20 09:15:22.380654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.381170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.382082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.382675 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.385399 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-c5cb1631-d240-4de3-a2c2-8abc3abddea2 req-a1601bb0-1ddf-4f79-b9fd-a450e2aff462 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 May 20 09:15:22.386928 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 189/346] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:22.413989 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:22.414607 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:22.421446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.421902 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.422860 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.423318 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.448682 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f82a1f27-5975-4608-935d-70a8d771642a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/ips" status: 200 len: 150 microversion: 2.1 time: 0.044419 May 20 09:15:22.449273 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 190/347] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:15:22 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:22.466258 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712133b246c94438b94c1f865dca1be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7264062888b544cfb7fbc74cc87f386f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:22.475216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-92c9083f-e6fc-412f-9b43-ab993676dca7 tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 200 len: 1298 microversion: 2.1 time: 0.106257 May 20 09:15:22.475912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 158/348] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:22 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:22.618196 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:22.618852 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:22.626006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.626447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.627194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:22.627641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:22.785768 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:22.795128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1694da6c-b27f-4791-93e9-8865e0152410 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.180608 May 20 09:15:22.801591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 191/349] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:22 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:23.492703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:23.493301 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] [instance: 00dbd10f-2b1d-4c58-b6e7-761738db0c0f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:23.500083 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:23.500550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:23.501333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:23.501744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:23.516801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] HTTP exception thrown: Instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f could not be found. May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Request method failure captured: May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f HTTP/1.1 May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vpBtNgKjefVrKK1S8bJ5VYGgp4Kgk2zVLGBpS3ssoNEn_JVrYgCGYTheBoBY-F--2IGKeNzwKsnDH6qQQjM997j3xVKjrbGdfmShXD2gEvfsbrO1YrcCBBA8nS24fgPob0VbjlzmdGWfg8R1l2FzM37y_5CUs7UdIalAZGd1s3IxE May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 7264062888b544cfb7fbc74cc87f386f May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesActionsTest-2038882880 May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:15:23.518447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7264062888b544cfb7fbc74cc87f386f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7264062888b544cfb7fbc74cc87f386f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7264062888b544cfb7fbc74cc87f386f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7264062888b544cfb7fbc74cc87f386f"}]}] May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesActionsTest-2038882880 May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 7264062888b544cfb7fbc74cc87f386f May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesActionsTest-2038882880 May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesActionsTest-2038882880-project May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 712133b246c94438b94c1f865dca1be9 May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesActionsTest-2038882880-project May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f could not be found. May 20 09:15:23.519815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '00dbd10f-2b1d-4c58-b6e7-761738db0c0f'} May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f could not be found. May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:15:23.520595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f could not be found. May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f could not be found. May 20 09:15:23.521713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:23.523062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] Returning 404 to user: Instance 00dbd10f-2b1d-4c58-b6e7-761738db0c0f could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:15:23.523062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-db504490-917e-40c2-8666-c68c7f26252f tempest-VolumesActionsTest-2038882880 tempest-VolumesActionsTest-2038882880-project] 10.222.0.69 "GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f" status: 404 len: 111 microversion: 2.1 time: 0.031034 May 20 09:15:23.523062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 159/350] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:23 2022] GET /compute/v2.1/servers/00dbd10f-2b1d-4c58-b6e7-761738db0c0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:15:23.812422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:23.813222 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:23.819987 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:23.820635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:23.821387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:23.821960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:23.902060 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f5e780-f5b5-441f-9abe-81f9965a71ae"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:23.903176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:23.909907 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:23.910420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:23.911292 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:23.911952 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:24.018746 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:24.032105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-79a54294-d346-4a3d-bd76-0e7681190aaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.223510 May 20 09:15:24.041640 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 192/351] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:23 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:24.276537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-73453238-eb37-404b-911d-e2c04d9b210d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379081 May 20 09:15:24.277983 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 160/352] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:15:23 2022] POST /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:15:25.049224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:25.049827 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:25.056042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:25.056503 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:25.057237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:25.057664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:25.196512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:25.204187 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-55b3aeeb-811d-4fc8-8fce-4ec91fc85e21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.159173 May 20 09:15:25.204735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 193/353] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:25 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:25.665264 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:25.665810 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:25.672657 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:25.673097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:25.673915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:25.674265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:25.700477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ca6282bf-446e-447f-845b-c5df3efcf5aa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/ips" status: 200 len: 145 microversion: 2.1 time: 0.039409 May 20 09:15:25.701311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 161/354] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:15:25 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:26.220758 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:26.221362 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:26.227527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:26.227968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:26.228726 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:26.229147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:26.358605 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:26.366276 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-11c6ced2-8de7-436b-ac4d-40030ad03c41 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.149593 May 20 09:15:26.366870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 194/355] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:26 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:27.387623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:27.388646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:27.399247 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:27.399717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:27.400468 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:27.400892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:27.547069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:27.554939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3fc76941-4c65-470a-b41b-d02bf818d87e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.174290 May 20 09:15:27.555613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 162/356] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:27 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:28.574300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:28.574908 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:28.578035 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:28.581576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:28.582014 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:28.583087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:28.583542 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:28.719911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:28.728008 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-686bebeb-ac8b-430e-9f8c-af575d555c72 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.158221 May 20 09:15:28.728594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 195/357] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:28 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:29.746092 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:29.746678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:29.753719 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:29.754184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:29.755908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:29.756557 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:29.892525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:29.899721 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1c8fcb52-c783-4496-be5d-665a8ff5b2ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.157473 May 20 09:15:29.900399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 163/358] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:29 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:29.920792 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c1e5cd-a911-44ee-8f45-9edf6f4fd693"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:29.921878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:29.928220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:29.928664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:29.929411 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:29.929840 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:30.252227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bb66fecf-e1cc-4676-933a-ec5d38435801 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335251 May 20 09:15:30.253218 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 196/359] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:15:29 2022] POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:30.918053 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:30.918588 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:30.925559 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:30.926002 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:30.926751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:30.927184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:31.064756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:31.072706 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-61694065-9183-4ecb-a61e-4037f14e199a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.158710 May 20 09:15:31.073276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 164/360] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:30 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:31.210466 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:31.211034 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:31.218912 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:31.219377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:31.220139 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:31.220567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:31.222988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:31.246400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cc194985-d2f9-4936-80b5-14257b19624a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/ips" status: 200 len: 151 microversion: 2.20 time: 0.040429 May 20 09:15:31.246971 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 197/361] 10.222.0.69 () {60 vars in 1288 bytes} [Fri May 20 09:15:31 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:15:32.089514 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:32.090233 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:32.092716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:32.098317 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:32.098717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:32.099689 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:32.100113 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:32.252509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:32.260270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0cc30d61-3598-4002-a336-b761e7f41b74 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.174726 May 20 09:15:32.260807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 165/362] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:32 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:33.277555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:33.278361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:33.291206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:33.291804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:33.292641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:33.293145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:33.605999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:33.615716 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4a66db5b-a286-4895-9714-2fead791a2a7 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.341998 May 20 09:15:33.616794 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 198/363] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:33 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:34.635593 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:34.636576 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:34.646010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:34.647073 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:34.648479 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:34.648974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:34.828721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:34.829906 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:34.843644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:34.845372 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:34.849544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:34.849989 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:34.850128 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:34.865185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2c71b6b1-df0d-4adc-b977-2d92300ffd7f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.234710 May 20 09:15:34.868722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 166/364] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:34 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:34.923932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lazy-loading 'flavor' on Instance uuid b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:15:35.061727 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-184cafe6-6aed-493d-9b60-15fbb4eb9b1b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: .version_select at 0x7f7c87762310>, body: {"keypair": {"name": "tempest-keypair-557494562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqCwRoVOhYMPpRkv7VTDEtrBIt+WabJF7meuHD6RZybdHAOUzEZdZOVeGFUmstsyrycRUfYpqx0JKpwLD6BivUkzmr08XZah5veE1LrfcKWEwbPhWW5m1nW7kc2/Cm7bA=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:35.077832 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-184cafe6-6aed-493d-9b60-15fbb4eb9b1b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:15:35.082023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-184cafe6-6aed-493d-9b60-15fbb4eb9b1b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:15:35.110732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-184cafe6-6aed-493d-9b60-15fbb4eb9b1b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056883 May 20 09:15:35.111359 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 167/365] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:15:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:15:35.894946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:35.896566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:35.904345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:35.905081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:35.905851 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:35.906450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:35.932214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:36.467929 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:36.477259 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2013c00c-b71c-49f9-b3ee-6671b68ffba1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.587080 May 20 09:15:36.477944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 168/366] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:35 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:37.088265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-482489554", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "328df357-f834-447d-8616-ac57cd7979a2"}], "security_groups": [{"name": "tempest-securitygroup--1276305789"}], "key_name": "tempest-keypair-557494562", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:44.104399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] validate_networks() for [('328df357-f834-447d-8616-ac57cd7979a2', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:15:44.211928 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-27f2f2fd-7068-41a6-911b-ae74cb37ac8b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/action" status: 202 len: 0 microversion: 2.20 time: 9.387612 May 20 09:15:44.216274 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 199/367] 10.222.0.69 () {62 vars in 1318 bytes} [Fri May 20 09:15:34 2022] POST /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/action => generated 0 bytes in 9393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 20 09:15:44.225893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:44.229085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:44.245183 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.245900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.249667 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.250309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.394548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:44.404810 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0f6831fd-7d82-474b-affa-9e689d9e9821 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.187268 May 20 09:15:44.405650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 200/368] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:44 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:44.410843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-17be78c8-1718-455f-b6f4-dba1f31f9e0b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:44.417633 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17be78c8-1718-455f-b6f4-dba1f31f9e0b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.418291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17be78c8-1718-455f-b6f4-dba1f31f9e0b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.483076 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-17be78c8-1718-455f-b6f4-dba1f31f9e0b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Going to try to stop instance {{(pid=117980) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 20 09:15:44.544156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-17be78c8-1718-455f-b6f4-dba1f31f9e0b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action" status: 202 len: 0 microversion: 2.1 time: 0.137085 May 20 09:15:44.545207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 201/369] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:15:44 2022] POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:15:44.550687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:44.551433 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:44.557916 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.558366 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.559122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.559572 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.587587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:15:44.588006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:15:44.588475 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:15:44.588877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:15:44.589310 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:15:44.598150 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.598586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.599567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.600029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.617406 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:15:44.621686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:15:44.657755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:15:44.663796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:15:44.708179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:44.712631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2876a5b6-822b-472b-a631-44e1c9d77bbe tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.631619 May 20 09:15:44.713531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 169/370] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:15:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 7633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 20 09:15:44.718061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:44.718722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:44.719055 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:44.720624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:44.721910 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4d3d5c50-7872-482b-9180-2780b9bbb15d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.175625 May 20 09:15:44.727313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 202/371] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:44 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:44.727313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5c31edf5-a564-480b-8605-74fbf7f403ba tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:44.727596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5c31edf5-a564-480b-8605-74fbf7f403ba tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:44.730118 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.730772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.731882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:44.732503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:44.793856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5c31edf5-a564-480b-8605-74fbf7f403ba tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:44.801313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5c31edf5-a564-480b-8605-74fbf7f403ba tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1240 microversion: 2.1 time: 0.077832 May 20 09:15:44.802211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 203/372] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:44 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:44.898443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:44.907552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2601beae-5d02-4aa3-941b-b6ca79eb0f1c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.193158 May 20 09:15:44.917628 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 170/373] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:44 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:45.424675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:45.425999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:45.436336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:45.437857 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:45.439373 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:45.440339 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:45.741586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:45.742212 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:45.749708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:45.750575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:45.751812 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:45.752472 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:45.945908 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:45.958822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5ee63759-70ac-4c15-8779-4a816e0d451d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.540694 May 20 09:15:45.960300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 204/374] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:45 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:45.967295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:45.968735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:45.978270 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:45.979251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:45.981725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:45.982893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:46.016307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:46.033286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:46.035245 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:46.036494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4a38a358-54df-43b2-9326-0c2005318cac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.299240 May 20 09:15:46.037496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 171/375] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:45 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:46.042269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:46.042878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:46.052374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:46.055373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:46.057370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:46.058197 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:46.080976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:46.107612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f9ad24ec-f943-4f67-b046-8931e12dd4ff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1292 microversion: 2.1 time: 0.143378 May 20 09:15:46.111658 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 205/376] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:45 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1292 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:46.247555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:46.257722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-29108bd4-68ff-4009-b27f-157e24b9949b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.219165 May 20 09:15:46.273655 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 172/377] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:46 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:46.976414 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:46.977816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:46.985188 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:46.986069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:46.987060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:46.987695 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.055242 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:47.056724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:47.088675 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:47.090280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.091495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:47.092113 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.204043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:47.214103 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6f090fb2-f30f-4083-b1c5-ae0118cd1885 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.241525 May 20 09:15:47.215119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 206/378] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:46 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:47.223421 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:47.225635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:47.235490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:47.236204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.237244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:47.237824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.315726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:47.328681 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:47.333098 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:47.335829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-907ebbfc-43fb-488c-becf-3b80140d7a52 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.285336 May 20 09:15:47.338658 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 173/379] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:47 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:47.344868 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:47.345751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:47.361282 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:47.362525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.363692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:47.365571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:47.376850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:47.385214 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-50e80ecf-efd8-4023-abaf-342716292e4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1298 microversion: 2.1 time: 0.168849 May 20 09:15:47.385796 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 207/380] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:47 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:47.563385 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:47.576473 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-17402aa1-9c65-409c-8031-b4f9e584295d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.235943 May 20 09:15:47.577253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 174/381] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:47 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:48.233677 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:48.235061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.245250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.247227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.249838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.250902 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.359031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:48.360081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.370353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.371414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.372905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.373694 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.500233 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:48.516294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8550bbbf-6575-4010-a6c3-cce2771046ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1501 microversion: 2.1 time: 0.287929 May 20 09:15:48.518086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 208/382] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:48 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1501 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:48.530476 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:48.531365 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.548619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.550294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.552903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.553627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.568895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:48.577587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:48.580538 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:48.582221 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6701cc54-b2f2-4b36-906e-3333101ad4ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.227162 May 20 09:15:48.582923 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 175/383] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:48 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:48.602501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ee0b41f-c8a2-42a2-8308-6d7f2d349047"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:48.604380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.612527 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.613275 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.614380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.615219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.642469 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] HTTP exception thrown: Cannot 'attach_volume' instance a97bdede-0305-4f4b-bc04-8b659b1c88ce while it is in vm_state rescued May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Request method failure captured: May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/os-volume_attachments HTTP/1.1 May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 74 May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1u0gzpwdtG3vy6mWamlIc0JNfTDCKnkS4SIiO2QpGgBLv6VLtVhm2Cx_-q7ygegAF8h1To5N5kpqxz6Obju8-I-oeEi0a91uAEw1KPehzRdb2mo9x3dF4fWRK15gOa7xynHPgCsfX5DVcj5xwy3flzTJPmMWW_d_9JU7Rlcyay0sTE May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:15:48.644395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed0e52a9d6374123b57759435d43d7aa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}] May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 992571802b7d426f923e0f0bc41e28de May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {"volumeAttachment": {"volumeId": "6ee0b41f-c8a2-42a2-8308-6d7f2d349047"}} May 20 09:15:48.645999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Cannot 'attach_volume' instance a97bdede-0305-4f4b-bc04-8b659b1c88ce while it is in vm_state rescued May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'server_id': 'a97bdede-0305-4f4b-bc04-8b659b1c88ce', 'body': {'volumeAttachment': {'volumeId': '6ee0b41f-c8a2-42a2-8308-6d7f2d349047'}}} May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce in vm_state rescued. Cannot attach_volume while the instance is in this state. May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:15:48.646870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a97bdede-0305-4f4b-bc04-8b659b1c88ce while it is in vm_state rescued May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:15:48.649127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:15:48.651173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:15:48.651173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:15:48.651173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a97bdede-0305-4f4b-bc04-8b659b1c88ce while it is in vm_state rescued May 20 09:15:48.651173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:15:48.651173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Returning 409 to user: Cannot 'attach_volume' instance a97bdede-0305-4f4b-bc04-8b659b1c88ce while it is in vm_state rescued {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:15:48.651173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1ba7f4a8-e0d8-48d1-a142-614b4d9bacaf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052054 May 20 09:15:48.655219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 176/384] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:15:48 2022] POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 20 09:15:48.660373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:48.661201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.667786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.668328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.669154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.669663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.806025 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:48.815616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a78855aa-ff26-4d9f-b099-7c9dcf191373 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.294940 May 20 09:15:48.816476 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 209/385] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:48 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:48.821322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:48.822122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.829617 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.830254 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.831329 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:48.831743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.832490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.845092 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-02163dd7-47cf-4662-a18b-b542951bf864 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.187873 May 20 09:15:48.856431 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 177/386] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:48 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:48.964513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-948f6587-7daf-42ab-a1c8-dc30983d6065 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/action" status: 202 len: 0 microversion: 2.1 time: 0.146364 May 20 09:15:48.965857 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 210/387] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:15:48 2022] POST /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:15:48.974803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:48.975824 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:48.983730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.984501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:48.985543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:48.986198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.221255 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-bb703bf3-526c-430c-93b9-d2123a0753a2 req-b2ae244e-db10-4ae9-bd04-b3e44ee92825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd40b569-94f7-46ca-9c6e-9fce603f84a6", "tag": "1d0fae47-b7b6-4830-9f35-b102d70a7a40"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:49.247158 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-bb703bf3-526c-430c-93b9-d2123a0753a2 req-b2ae244e-db10-4ae9-bd04-b3e44ee92825 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.267364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-bb703bf3-526c-430c-93b9-d2123a0753a2 req-b2ae244e-db10-4ae9-bd04-b3e44ee92825 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.284162 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:49.284482 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:49.293157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a6ee4c38-22e5-4b6e-8e2b-a6c7351836f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1509 microversion: 2.1 time: 0.322599 May 20 09:15:49.293744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 178/388] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:48 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:49.315492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-bb703bf3-526c-430c-93b9-d2123a0753a2 req-b2ae244e-db10-4ae9-bd04-b3e44ee92825 service nova] Creating event network-changed:1d0fae47-b7b6-4830-9f35-b102d70a7a40 for instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 on hv-cinder-83699 May 20 09:15:49.326228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-bb703bf3-526c-430c-93b9-d2123a0753a2 req-b2ae244e-db10-4ae9-bd04-b3e44ee92825 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109366 May 20 09:15:49.327480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 211/389] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:15:49.603395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:49.604214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:49.615284 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.618842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.620146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.623126 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.834507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:49.835710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:49.847791 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.848450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.849401 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.850004 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.904243 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:49.920960 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:49.923230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:49.925159 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3107de28-79d5-4172-a0fb-97e8cc5abf6e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.326964 May 20 09:15:49.926450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 179/390] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:49 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:49.931757 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:49.932711 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:49.942088 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.942695 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:49.943586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:49.944450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:50.024543 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:50.034152 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cbefeb54-886b-4157-856e-0c3619eb3ab4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.205030 May 20 09:15:50.034733 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 212/391] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:49 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:50.113280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:50.125231 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cc8cc794-c400-442d-adf5-99dc8d0ee4b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.195032 May 20 09:15:50.125231 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 180/392] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:49 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:50.310607 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:50.311244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:50.318115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:50.318587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:50.319380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:50.319804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:50.474041 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:50.482509 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1e3e229a-75f6-49a2-bfd2-27262e40705b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1509 microversion: 2.1 time: 0.175792 May 20 09:15:50.483072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 213/393] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:50 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:50.946111 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:50.947013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:50.953785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:50.954224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:50.955072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:50.955652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.055215 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:51.056652 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:51.086656 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:51.087511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.089177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:51.090346 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.098103 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:51.107127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:51.109678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:51.110949 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4ec557b8-bea1-4b8b-a394-488943b1cd84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.169265 May 20 09:15:51.111907 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 181/394] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:50 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:51.142384 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:51.143124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:51.150264 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:51.150895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.151764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:51.152277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.258906 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:51.267475 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4551060b-3711-4351-a3f1-031e717b656a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.217400 May 20 09:15:51.277204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 214/395] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:51 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:51.302642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:51.313028 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-db0a945c-5281-4112-993a-f65e4fee4663 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.174843 May 20 09:15:51.315300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 182/396] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:51 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:51.500915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:51.501809 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:51.511382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:51.512371 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.513602 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:51.514260 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:51.664125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:51.672326 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-18ebce41-0ec1-4c48-836c-a9759a8d5063 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1509 microversion: 2.1 time: 0.175816 May 20 09:15:51.673208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 215/397] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:51 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:52.141226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:52.141226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:52.156847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.157300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.158110 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.158539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.287207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:52.288189 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:52.299304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.300291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.301069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.301531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.360606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:52.369650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:52.371822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:52.373227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-62f8979c-e29a-4dbe-afd5-a38998f24191 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.245019 May 20 09:15:52.374374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 183/398] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:52 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:52.379001 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:52.379866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:52.386133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.386856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.387829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.388439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.462741 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:52.471636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-37a14430-7f9c-4aa2-8b68-d66a19881468 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.190241 May 20 09:15:52.472766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 216/399] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:52 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:52.573653 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:52.582341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eec324de-45e9-4020-b2f5-bdae53f00556 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.206781 May 20 09:15:52.583492 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 184/400] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:52 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:52.690095 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:52.690611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:52.699042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.699985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.700946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:52.701642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:52.859683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:52.864132 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bc0ea45d-b75d-456e-8b15-11a1e8192a67 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1509 microversion: 2.1 time: 0.178036 May 20 09:15:52.866638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 217/401] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:52 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:53.396307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:53.397836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:53.404643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.405087 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.405861 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.406298 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.490242 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:53.490853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:53.497911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.498621 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.499592 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.500154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.567641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:53.578493 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:53.580047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:53.582007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f3d8d571-0741-4e56-bc83-0d8f92313072 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.189145 May 20 09:15:53.582007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 185/402] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:53 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:53.603486 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:53.603486 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:53.609006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.609456 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.610230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.610662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.613707 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:53.675825 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:53.686939 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-59b6c24c-13ad-4f80-8ab9-4d5e7b065369 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.201558 May 20 09:15:53.688075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 218/403] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:53 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:53.777001 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:53.796350 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7d4cfe16-dace-4fc8-8698-c6cbe9051cf2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.199882 May 20 09:15:53.797567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 186/404] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:53 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:53.880900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:53.882228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:53.889309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.890009 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:53.891183 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:53.891978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.058669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:54.072153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a7d7b06a-81bc-466f-ab65-4f26c326aa39 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1509 microversion: 2.1 time: 0.194571 May 20 09:15:54.084167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 219/405] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:53 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:54.599791 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:54.600499 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:54.607750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:54.610335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:54.610955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.612168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:54.612811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.647944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=10 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:54.705259 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:54.705885 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:54.712068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:54.712563 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.713305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:54.713727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.746714 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:54.754945 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:54.756556 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:54.757839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c3253023-a0fa-4be6-9b46-dca146f12dac tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.162364 May 20 09:15:54.758428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 187/406] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:54 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:54.803948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:54.813980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:54.814585 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:54.820678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:54.821130 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.821935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:54.822376 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:54.850643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:54.858696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-616199ea-6c38-4310-b9b4-b59a47f87f60 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.157278 May 20 09:15:54.859387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 220/407] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:54 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:54.955753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:54.964007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5899acd6-7da7-4a0b-a552-23a35322b253 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.153888 May 20 09:15:54.964608 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 188/408] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:54 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:55.090488 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:55.091112 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:55.098546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.099008 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.099924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.100499 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.230014 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:55.241525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-69e89217-23d2-4846-ac86-bce32e1d6d12 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1509 microversion: 2.1 time: 0.154868 May 20 09:15:55.242406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 221/409] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:55 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:55.782251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:55.783236 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:55.793167 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.793605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.794355 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.794779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.875989 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:55.876594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:55.882981 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.883465 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.884244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.884722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.925133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:55.933343 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:55.934821 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:55.936016 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6b5d134b-d73c-4a04-8499-341a897a4c9c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.162079 May 20 09:15:55.936572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 189/410] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:55 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:55.981410 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:55.982011 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:55.988425 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.988866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:55.989713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:55.990141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:56.021408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:56.030185 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ce00bcc3-c772-408a-ac43-acca5b71f5e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.157975 May 20 09:15:56.030687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 222/411] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:55 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:56.126941 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:56.135053 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-104fbef1-13d6-4837-bfee-f951178a84f4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.157390 May 20 09:15:56.135651 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 190/412] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:55 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:56.258919 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:56.259589 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:56.266323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:56.266769 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:56.267613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:56.268007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:56.404839 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:56.412406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-48fe7baf-ef44-45f7-a1a5-a4e764e7899c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1515 microversion: 2.1 time: 0.157412 May 20 09:15:56.413089 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 223/413] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:56 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:56.954222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:56.954820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:56.961817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:56.962411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:56.963238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:56.963908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:57.046734 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:57.047871 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:57.054268 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:57.054710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:57.055585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:57.056107 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:57.108735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:57.116933 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:57.118415 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:57.119657 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f9706947-073e-4d00-ba01-14e23b9d65c6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.169557 May 20 09:15:57.120222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 191/414] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:56 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:57.152503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:57.153197 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:57.159306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:57.159748 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:57.160652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:57.161080 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:57.265212 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:57.273602 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ab770d5b-692f-4451-adaa-4012b95cc1c6 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.231071 May 20 09:15:57.274161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 224/415] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:57 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:57.293377 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:57.301915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1d0ef8c4-0179-46d5-91e8-b4d8f755f19f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.153366 May 20 09:15:57.302502 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 192/416] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:57 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:57.696616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-041c0607-a7a0-47c1-bcaf-c5429fbe7704 req-ce9846c7-55df-46c2-8b4b-2ffe08f53174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd40b569-94f7-46ca-9c6e-9fce603f84a6", "name": "network-vif-plugged", "status": "completed", "tag": "1d0fae47-b7b6-4830-9f35-b102d70a7a40"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:57.704814 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-041c0607-a7a0-47c1-bcaf-c5429fbe7704 req-ce9846c7-55df-46c2-8b4b-2ffe08f53174 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:57.705283 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-041c0607-a7a0-47c1-bcaf-c5429fbe7704 req-ce9846c7-55df-46c2-8b4b-2ffe08f53174 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:57.717096 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-041c0607-a7a0-47c1-bcaf-c5429fbe7704 req-ce9846c7-55df-46c2-8b4b-2ffe08f53174 service nova] Creating event network-vif-plugged:1d0fae47-b7b6-4830-9f35-b102d70a7a40 for instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 on hv-cinder-83699 May 20 09:15:57.722646 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-041c0607-a7a0-47c1-bcaf-c5429fbe7704 req-ce9846c7-55df-46c2-8b4b-2ffe08f53174 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029659 May 20 09:15:57.723560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 225/417] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:58.138382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:58.138985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:58.146000 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:58.146443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:58.147568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:58.147969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:58.278149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:58.286639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:58.288134 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:58.289297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0187dd7f-1b38-4b34-b1d9-d2a6968738c2 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.155008 May 20 09:15:58.289859 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 193/418] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:58 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:58.291058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:58.291820 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:58.298197 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:58.298639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:58.299411 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:58.299867 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:58.319028 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:58.319926 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:58.326023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:58.326465 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:58.327178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:58.327629 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:58.435757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:58.445364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32115a76-e0d2-4ee4-90e1-aa17bab9879b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.158810 May 20 09:15:58.446174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 226/419] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:58 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:15:58.460845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:58.469198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e275e1ce-bb99-4f59-b0ea-f8f4403f85fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.154037 May 20 09:15:58.469774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 194/420] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:58 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:58.840850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0c381b9d-60af-47be-8f29-40cc86485b2d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'create', calling method: .version_select at 0x7f7c86f39040>, body: {"keypair": {"name": "tempest-keypair-2129922101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWb884Uxl5zNJayQhTSfOOun5fQ6N18/KypbEVW2mH/ERwRbrcUUkbTPPX1I7NI6g9LIn+3vpm9f2EhShO79zwnF6srfP0AmS8Amowxh618FNByPd5oHtVCrt/xN71xFA=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:15:58.845726 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=66 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:15:58.857745 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-0c381b9d-60af-47be-8f29-40cc86485b2d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for project ed0e52a9d6374123b57759435d43d7aa. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:15:58.862457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-0c381b9d-60af-47be-8f29-40cc86485b2d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for user 992571802b7d426f923e0f0bc41e28de and project ed0e52a9d6374123b57759435d43d7aa. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:15:58.891755 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0c381b9d-60af-47be-8f29-40cc86485b2d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055621 May 20 09:15:58.899412 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 227/421] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:15:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:15:59.307771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:59.308447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:59.315207 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:59.315906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:59.316677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:59.317108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:59.462697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:59.464244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:59.478402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:59.478850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:59.484230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:59.484759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:59.545194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:59.557977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:59.561324 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:59.562745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-558cfde9-961f-435f-ab5c-ba7a7beb5a5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.258925 May 20 09:15:59.563823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 195/422] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:15:59 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:15:59.568562 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:15:59.569160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:15:59.576042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:59.576807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:59.577957 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:15:59.578389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:15:59.814277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:59.825088 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-642aa81c-df40-4fe5-b520-7609db579a5f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.260215 May 20 09:15:59.825825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 196/423] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:59 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:15:59.888778 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:15:59.898663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6d1b69e1-9e22-44ac-80c1-262e2eb076cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1366 microversion: 2.1 time: 0.439666 May 20 09:15:59.909113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 228/424] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:15:59 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:16:00.582104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:00.582644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:00.589544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:00.589841 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:00.590477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:00.590896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:00.845706 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:00.846384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:00.850745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:00.861584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:00.862358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:00.863131 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:00.863595 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:00.868714 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:00.873575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:00.876185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d07fcdb0-0bbe-4a9e-add7-174117ae514d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.298087 May 20 09:16:00.876746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 197/425] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:00 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:00.916491 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:00.917223 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:00.924253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:00.924891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:00.925938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:00.926511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.020224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:01.030005 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1751b7fd-ac27-4fe2-b17c-2af01cd82503 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.191666 May 20 09:16:01.030903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 229/426] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:00 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:01.046240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-148545473", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40febe0e-a58d-4d88-9cb1-48f696a34f45"}], "security_groups": [{"name": "tempest-securitygroup--616825558"}], "key_name": "tempest-keypair-2129922101", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:01.100308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:01.108585 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bdb32599-a868-4d78-9c12-22f98407b679 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1555 microversion: 2.1 time: 0.196048 May 20 09:16:01.109533 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 198/427] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:00 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:16:01.128024 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:01.129102 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:01.137007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:01.138104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.139066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:01.139788 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.183570 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] validate_networks() for [('40febe0e-a58d-4d88-9cb1-48f696a34f45', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:16:01.228227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-62192171-3973-4732-82dd-1045419e7c04 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105307 May 20 09:16:01.234774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 199/428] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:16:01 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:01.894660 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:01.896700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:01.913834 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:01.914347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.915232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:01.915550 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:16:01.916009 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.916105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:16:01.916576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:16:01.916987 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:16:01.917580 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:16:01.929585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:01.930024 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.930809 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:01.931237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:01.950054 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:01.968980 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for project ed0e52a9d6374123b57759435d43d7aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:16:01.975842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Getting quotas for user 992571802b7d426f923e0f0bc41e28de and project ed0e52a9d6374123b57759435d43d7aa. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:16:01.990428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:16:01.993042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:16:02.060252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0d11713c-8299-40bb-b493-f831440ea0b3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.018200 May 20 09:16:02.061886 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 230/429] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:16:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:16:02.067624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:02.068497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:02.076891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:02.077779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:02.078843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:02.079690 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:02.307751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:02.319007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1b6964bf-667f-4947-baa2-be0bf4b310d1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.255393 May 20 09:16:02.339159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 231/430] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:02 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:02.345149 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ad113b55-9b6a-4555-a330-b3e17b1e6cb5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:02.345985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ad113b55-9b6a-4555-a330-b3e17b1e6cb5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:02.404690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:02.413552 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ad113b55-9b6a-4555-a330-b3e17b1e6cb5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:02.416300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:02.418213 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:02.419873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2accdc2c-64ce-4b7f-8cc0-0237c44b7faf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.529672 May 20 09:16:02.420965 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 200/431] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:01 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:16:02.422567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ad113b55-9b6a-4555-a330-b3e17b1e6cb5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1245 microversion: 2.1 time: 0.082236 May 20 09:16:02.423333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 232/432] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:02 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:02.774626 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-d37602ba-a464-4831-90c6-746692e455ce req-dc1f852a-70cf-4d50-b0cb-e10cf0b68489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd40b569-94f7-46ca-9c6e-9fce603f84a6", "tag": "1d0fae47-b7b6-4830-9f35-b102d70a7a40"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:02.780193 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:02.788185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-d37602ba-a464-4831-90c6-746692e455ce req-dc1f852a-70cf-4d50-b0cb-e10cf0b68489 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:02.788623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-d37602ba-a464-4831-90c6-746692e455ce req-dc1f852a-70cf-4d50-b0cb-e10cf0b68489 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:02.801284 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-d37602ba-a464-4831-90c6-746692e455ce req-dc1f852a-70cf-4d50-b0cb-e10cf0b68489 service nova] Creating event network-changed:1d0fae47-b7b6-4830-9f35-b102d70a7a40 for instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 on hv-cinder-83699 May 20 09:16:02.806636 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-d37602ba-a464-4831-90c6-746692e455ce req-dc1f852a-70cf-4d50-b0cb-e10cf0b68489 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036959 May 20 09:16:02.807208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 201/433] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:03.346263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:03.347486 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:03.354295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:03.354924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:03.355722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:03.356150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:03.438908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:03.439866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:03.460672 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:03.461216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:03.462413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:03.462854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:03.501629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:03.512279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9f04ad51-fce0-40ca-9039-e71e907d8313 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.170076 May 20 09:16:03.513712 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 233/434] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:03 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:03.523609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:03.524559 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:03.532189 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:03.532784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:03.533920 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:03.534599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:03.635919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:03.655539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:03.658285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:03.660652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-46d95ee8-be92-4c1b-a6dd-67627a8b03d0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.225848 May 20 09:16:03.661962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 202/435] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:03 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:03.689884 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:03.699620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5b4c32e0-69fe-4726-9d0d-083dad299754 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1249 microversion: 2.1 time: 0.181543 May 20 09:16:03.700774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 234/436] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:03 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1249 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:04.530238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:04.531562 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:04.538670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:04.539127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:04.540509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:04.541110 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:04.680435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:04.681031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:04.687883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:04.688293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:04.689273 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:04.689705 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:04.780217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:04.786593 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:04.790052 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-428f9f94-b8ef-4ccc-93bf-78fa233d5915 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.264059 May 20 09:16:04.790632 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 203/437] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:04 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:04.806745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:04.807685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:04.816486 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:04.817329 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:04.818659 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:04.819238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:04.890528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:04.901575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:04.903933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:04.905846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5a04d80a-c803-49d9-8faa-d243e3ac0b0d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1743 microversion: 2.20 time: 0.228900 May 20 09:16:04.906786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 235/438] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:04 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:16:04.922297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:04.932119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c8c394ca-8e5d-41c2-a606-e6aef5d77dbb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1303 microversion: 2.1 time: 0.130553 May 20 09:16:04.934085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 204/439] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:04 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:05.816015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:05.817589 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:05.841188 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:05.841913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:05.842698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:05.843118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:05.924583 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:05.925892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:05.936829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:05.939142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:05.940126 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:05.940563 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:06.169560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:06.184106 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d1240c89-a25b-45f7-8c98-ec62186f5fac tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1723 microversion: 2.1 time: 0.378568 May 20 09:16:06.184711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 236/440] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:05 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:06.189532 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:06.189918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:06.237461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:06.238019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:06.238858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:06.239723 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:06.407250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:06.417643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:06.425156 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:06.426389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a5b22f66-e526-40d1-8c29-5a98dcbaceb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1743 microversion: 2.20 time: 0.505790 May 20 09:16:06.441989 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 205/441] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:05 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1743 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:06.453420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-23f9e6d1-0682-45e5-b332-2974f389aa37 req-a06540a4-2cef-4b72-8f8d-f7c9c1d4eafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bf483f-196d-4699-8ca8-968382aecdac", "tag": "7c2e256c-0d81-4712-b95d-356933f6fd80"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:06.462576 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-23f9e6d1-0682-45e5-b332-2974f389aa37 req-a06540a4-2cef-4b72-8f8d-f7c9c1d4eafb service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:06.463398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-23f9e6d1-0682-45e5-b332-2974f389aa37 req-a06540a4-2cef-4b72-8f8d-f7c9c1d4eafb service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:06.488738 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:06.495456 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-23f9e6d1-0682-45e5-b332-2974f389aa37 req-a06540a4-2cef-4b72-8f8d-f7c9c1d4eafb service nova] Creating event network-changed:7c2e256c-0d81-4712-b95d-356933f6fd80 for instance d6bf483f-196d-4699-8ca8-968382aecdac on hv-cinder-83699 May 20 09:16:06.503207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a4aae290-827b-44fc-abda-26fa6b02d19d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.316337 May 20 09:16:06.505414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-23f9e6d1-0682-45e5-b332-2974f389aa37 req-a06540a4-2cef-4b72-8f8d-f7c9c1d4eafb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061805 May 20 09:16:06.506193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 237/442] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:06 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:06.507353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 206/443] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:07.202165 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:07.202766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:07.209460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.209896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.210648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.211074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.345252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:07.355508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4ac307a3-a1b6-4f17-a5d8-58a5aa2c0cd4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1700 microversion: 2.1 time: 0.157043 May 20 09:16:07.356133 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 238/444] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:07 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:16:07.374269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3046c75c-3284-4370-bfa5-254d7ad80078 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:07.381340 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3046c75c-3284-4370-bfa5-254d7ad80078 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.381854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3046c75c-3284-4370-bfa5-254d7ad80078 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.448585 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3046c75c-3284-4370-bfa5-254d7ad80078 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Going to try to start instance {{(pid=117981) start /opt/stack/nova/nova/compute/api.py:2730}} May 20 09:16:07.459442 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:07.460069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:07.469485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.470555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.471567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.472001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.505363 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3046c75c-3284-4370-bfa5-254d7ad80078 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action" status: 202 len: 0 microversion: 2.1 time: 0.136172 May 20 09:16:07.509698 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 207/445] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:16:07 2022] POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:16:07.515314 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:07.516090 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:07.523528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.523971 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.524728 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.525352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.642787 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:07.651854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:07.653449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:07.664063 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a6394fe6-0cdf-48cc-bfaf-30b4acda0622 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.213216 May 20 09:16:07.665423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 239/446] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:07 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:07.678979 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:07.681307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:07.691536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.692037 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.692732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.693575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.771194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:07.782747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-daad1805-c0d9-4a3d-9c52-006e09b80e5b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1709 microversion: 2.1 time: 0.271359 May 20 09:16:07.787411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 208/447] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:07 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1709 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:16:07.820980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b6bd4031-b325-4e02-95c4-2979c0720747 req-e8f32a78-176b-4012-b88e-3af7fa26b6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "name": "network-vif-plugged", "status": "completed", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:07.837642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b6bd4031-b325-4e02-95c4-2979c0720747 req-e8f32a78-176b-4012-b88e-3af7fa26b6ce service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:07.838235 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b6bd4031-b325-4e02-95c4-2979c0720747 req-e8f32a78-176b-4012-b88e-3af7fa26b6ce service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:07.850282 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b6bd4031-b325-4e02-95c4-2979c0720747 req-e8f32a78-176b-4012-b88e-3af7fa26b6ce service nova] Creating event network-vif-plugged:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:16:07.855977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b6bd4031-b325-4e02-95c4-2979c0720747 req-e8f32a78-176b-4012-b88e-3af7fa26b6ce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038622 May 20 09:16:07.856545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 209/448] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:16:07.928231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:07.940914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5b9bf48a-7034-4a19-b5b1-b44b0f886377 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.275027 May 20 09:16:07.942102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 240/449] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:07 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:08.682863 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:08.683630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:08.689866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:08.690509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:08.691349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:08.691783 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:08.804615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:08.806856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:08.815800 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:08.816721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:08.818763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:08.819525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:08.889859 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:08.904105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:08.906628 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:08.908221 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-af8e2fc0-96f4-43d8-bb7a-3193a0fa3dbd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.230095 May 20 09:16:08.909058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 210/450] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:08 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:08.958811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:08.960554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:08.973679 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:08.974035 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:08.974822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:08.977696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:08.982898 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:08.991783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9ff43d49-cd57-4b46-8fab-cd641e3b65b1 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1709 microversion: 2.1 time: 0.190944 May 20 09:16:08.993322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 241/451] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:08 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:16:09.182865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:09.198117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ca28447e-5703-46d8-8da8-bd09cf9b470d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.243119 May 20 09:16:09.201464 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 211/452] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:08 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:09.927344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:09.927993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:09.941798 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:09.942239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:09.943005 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:09.943460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:10.012196 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:10.013602 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:10.024198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:10.024666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:10.025538 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:10.026654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:10.206182 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:10.216124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:10.218191 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:10.219564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-613ee37c-2563-4ebe-82c7-2410929a0774 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.296717 May 20 09:16:10.220578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 242/453] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:09 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:10.228607 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:10.232446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:10.233397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:10.239609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3bd494ad-f579-4a93-a5a3-d375d5bde920 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1713 microversion: 2.1 time: 0.232474 May 20 09:16:10.240167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:10.240803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:10.251082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 212/454] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:10 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1713 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:16:10.252673 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:10.253122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:10.450707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:10.460297 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ac518629-0556-47b2-8b79-1299dc38d01f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.238490 May 20 09:16:10.463734 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 243/455] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:10 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:11.241826 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:11.243633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:11.257613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:11.258852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:11.260106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:11.295473 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:11.478211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:11.478836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:11.486089 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:11.486528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:11.487321 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:11.487771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:11.520256 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:11.549869 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:11.551999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:11.556419 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-296379a3-df0f-4fa0-ae08-647f597a80c0 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.320013 May 20 09:16:11.568360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 213/456] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:11 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:11.770434 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:11.786092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-605169f1-9705-4f06-9f70-94501ac6e42a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.312228 May 20 09:16:11.798069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 244/457] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:11 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:11.872852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-a29e293a-b07e-4410-bcc7-83ad3d949f10 req-65c9d897-502c-4eec-8bb9-64257a8db8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bf483f-196d-4699-8ca8-968382aecdac", "name": "network-vif-plugged", "status": "completed", "tag": "7c2e256c-0d81-4712-b95d-356933f6fd80"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:11.886117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a29e293a-b07e-4410-bcc7-83ad3d949f10 req-65c9d897-502c-4eec-8bb9-64257a8db8d8 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:11.886612 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a29e293a-b07e-4410-bcc7-83ad3d949f10 req-65c9d897-502c-4eec-8bb9-64257a8db8d8 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:11.908226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-a29e293a-b07e-4410-bcc7-83ad3d949f10 req-65c9d897-502c-4eec-8bb9-64257a8db8d8 service nova] Creating event network-vif-plugged:7c2e256c-0d81-4712-b95d-356933f6fd80 for instance d6bf483f-196d-4699-8ca8-968382aecdac on hv-cinder-83699 May 20 09:16:11.925960 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-a29e293a-b07e-4410-bcc7-83ad3d949f10 req-65c9d897-502c-4eec-8bb9-64257a8db8d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056859 May 20 09:16:11.926857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 214/458] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:12.574489 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:12.575190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:12.577510 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:12.579341 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=12 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:12.591371 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:12.591935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:12.595728 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:12.601030 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:12.806999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:12.810710 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:12.817815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:12.818265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:12.819036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:12.819494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:12.826684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:12.838758 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:12.840822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:12.842305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d416bf1b-f116-4a24-896b-45f67f8c35be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.271820 May 20 09:16:12.853182 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 245/459] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:12 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:13.014605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:13.023610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9c35eb1c-92b8-4198-9bae-9842599ed00f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.222371 May 20 09:16:13.026420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 215/460] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:12 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:13.860943 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:13.861534 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:13.879567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:13.881522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:13.883213 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:13.883838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:14.045259 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:14.047835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:14.069933 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:14.072149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:14.077140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:14.078741 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:14.124263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:14.145134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:14.147381 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:14.148921 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f34c84f0-de87-42e3-9c52-28dadad9c03d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.292685 May 20 09:16:14.150057 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 246/461] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:13 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:14.307545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:14.322559 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e28a5efa-8cf3-4711-adfa-c476ef9378ae tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1370 microversion: 2.1 time: 0.281801 May 20 09:16:14.323183 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 216/462] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:14 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:15.169684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:15.170291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:15.180946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:15.181435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:15.184474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:15.185006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:15.338444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:15.339041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:15.349181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:15.352283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:15.353124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:15.353570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:15.447732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:15.460360 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:15.461964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:15.463190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-75a0a4b1-111f-41e6-86bc-dfea28f0d189 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.297425 May 20 09:16:15.467582 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 247/463] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:15 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:15.670438 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:15.686742 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c1b5aea8-a184-4fce-903d-6b808922c5d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1564 microversion: 2.1 time: 0.352076 May 20 09:16:15.691514 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 217/464] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:15 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1564 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:15.705970 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:15.706494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:15.717458 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:15.718159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:15.719161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:15.719597 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:15.737374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:15.825879 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a754f9d4-96f0-4451-9b18-de84291cc52c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124480 May 20 09:16:15.826870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 248/465] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:16:15 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:16.481795 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:16.482402 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:16.497262 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:16.499184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:16.500849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:16.502141 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:16.933501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:16.943527 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:16.952495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:16.953971 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ed1c31be-f3e6-4fa1-acc2-b34966172968 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.476366 May 20 09:16:16.955196 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 218/466] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:16 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:17.973482 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:17.975154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:17.994104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:17.994401 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:17.998171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:17.998817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:18.267390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:18.286314 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:18.288032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:18.290240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aaade4d7-5ba2-4442-9407-1f353a29371e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.321928 May 20 09:16:18.311787 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 249/467] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:17 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:18.409013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-71f3885c-d92d-466e-96f1-e23dfb990c7f req-1e1b176d-c85e-4732-8246-51b94f084fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bf483f-196d-4699-8ca8-968382aecdac", "tag": "7c2e256c-0d81-4712-b95d-356933f6fd80"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:18.419809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-71f3885c-d92d-466e-96f1-e23dfb990c7f req-1e1b176d-c85e-4732-8246-51b94f084fcd service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:18.420240 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-71f3885c-d92d-466e-96f1-e23dfb990c7f req-1e1b176d-c85e-4732-8246-51b94f084fcd service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:18.435962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-71f3885c-d92d-466e-96f1-e23dfb990c7f req-1e1b176d-c85e-4732-8246-51b94f084fcd service nova] Creating event network-changed:7c2e256c-0d81-4712-b95d-356933f6fd80 for instance d6bf483f-196d-4699-8ca8-968382aecdac on hv-cinder-83699 May 20 09:16:18.443990 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-71f3885c-d92d-466e-96f1-e23dfb990c7f req-1e1b176d-c85e-4732-8246-51b94f084fcd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038525 May 20 09:16:18.445462 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 219/468] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:19.331735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:19.333851 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:19.345145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:19.350659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:19.351823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:19.352513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:19.594754 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:19.612373 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:19.615507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:19.617024 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-deda7936-ce96-4ed8-bca1-53679c829e49 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.290840 May 20 09:16:19.628384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 250/469] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:19 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:20.641073 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:20.641073 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:20.655603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:20.656263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:20.672782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:20.674461 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:21.096995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:21.111104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:21.117432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:21.120862 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-031313c0-331e-412f-a8dc-91647f9a7ac9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.486129 May 20 09:16:21.135514 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 220/470] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:20 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:22.142385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:22.142991 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:22.150103 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:22.150544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:22.151369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:22.151883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:22.298847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:22.308068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:22.309549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:22.310706 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-63b6b518-e670-425e-8796-29fff997566c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.172486 May 20 09:16:22.311251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 251/471] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:22 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:23.330171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:23.331487 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:23.338796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:23.339862 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:23.340795 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:23.341217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:23.484374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:23.493344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:23.495218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:23.497494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d51fa78c-c818-4411-b3c4-550fcbbdee3d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1738 microversion: 2.20 time: 0.172377 May 20 09:16:23.498261 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 221/472] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:23 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:24.517085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:24.518570 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:24.549221 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:24.562828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:24.567590 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:24.569455 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:24.887777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:24.897060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:24.898563 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:24.908504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d31e89a6-2af2-41e6-828f-14799a0c3635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1720 microversion: 2.20 time: 0.396079 May 20 09:16:24.917777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 252/473] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:24 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1720 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:25.931462 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:25.932596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:25.948198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:25.948875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:25.949647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:25.950068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:25.953114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:26.306316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:26.315915 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:26.324127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:26.325575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-abab9263-543f-41bd-8eb2-2110ce6d65fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1720 microversion: 2.20 time: 0.400890 May 20 09:16:26.326490 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 222/474] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:25 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1720 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:27.348501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:27.349425 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:27.363380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:27.367727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:27.369098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:27.370511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:27.656420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:27.666817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:27.668738 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:27.670141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6304757a-04fa-487e-ba09-23fa23576d82 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1720 microversion: 2.20 time: 0.329815 May 20 09:16:27.671299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 253/475] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:27 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:28.381663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d2635791-4cd2-4abb-99b9-2a4331400174 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Action: 'create', calling method: .version_select at 0x7f7c8c02b1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-276577009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7ekyGQG2N8vVI/nGnol7pVsD4gKTXvsTbq9pGfDFSPZV5x/k9QRgJD4+fl1GWw6ZPrNv64lcU6DjLq/X+O6gIlqWS9eTQ1n7uRdh348zFaeehFUP/sdCjyBJUjvmWIfw=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:28.396747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-d2635791-4cd2-4abb-99b9-2a4331400174 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for project f26ac8782fe0407cb6f146ba70e74246. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:16:28.400763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-d2635791-4cd2-4abb-99b9-2a4331400174 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for user bc0307909d614a1f97f006dc6d091cd4 and project f26ac8782fe0407cb6f146ba70e74246. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:16:28.424510 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d2635791-4cd2-4abb-99b9-2a4331400174 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.228760 May 20 09:16:28.425144 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 223/476] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:16:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:28.659807 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-6d4077b3-5507-4f6f-8659-7d2653dae71b req-a77ccc8a-d01a-4cc1-8e27-64dea3eab5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "name": "network-vif-unplugged", "status": "completed", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:28.669022 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6d4077b3-5507-4f6f-8659-7d2653dae71b req-a77ccc8a-d01a-4cc1-8e27-64dea3eab5c4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:28.669522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6d4077b3-5507-4f6f-8659-7d2653dae71b req-a77ccc8a-d01a-4cc1-8e27-64dea3eab5c4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:28.686764 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-6d4077b3-5507-4f6f-8659-7d2653dae71b req-a77ccc8a-d01a-4cc1-8e27-64dea3eab5c4 service nova] Creating event network-vif-unplugged:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:16:28.688422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:28.689276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:28.694162 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-6d4077b3-5507-4f6f-8659-7d2653dae71b req-a77ccc8a-d01a-4cc1-8e27-64dea3eab5c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038020 May 20 09:16:28.695118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 254/477] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:16:28.697243 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:28.697752 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:28.698722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:28.700708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:28.862362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:28.873697 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:28.876081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:28.879771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-677734e5-474c-4efe-8a43-8aa4961a80ab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1720 microversion: 2.20 time: 0.192949 May 20 09:16:28.886974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 224/478] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:28 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:29.898646 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:29.899358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:29.901816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:29.907494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:29.908100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:29.909252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:29.909852 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:30.063467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:30.073103 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:30.075342 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:30.077778 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-75a4dc80-167c-4d56-8e3a-649992fdc0be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1720 microversion: 2.20 time: 0.183983 May 20 09:16:30.078950 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 255/479] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:29 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:31.096276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:31.096890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:31.104367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:31.104816 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:31.105587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:31.106121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:31.277008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:31.286423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:31.287016 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:31.291346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-143ee7f2-e771-46ac-9edc-fedf1b145b50 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1720 microversion: 2.20 time: 0.196319 May 20 09:16:31.297223 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 225/480] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:31 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:32.310337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:32.310951 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:32.318842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:32.319568 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:32.320335 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:32.320768 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:32.477746 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:32.487148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:32.488618 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:32.489786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-650b4e7a-c4db-483d-9bbd-b59bda7b8a84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1663 microversion: 2.20 time: 0.183773 May 20 09:16:32.490556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 256/481] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:32 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:32.507687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed93e262-c68b-46ba-8eed-840da1255408"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:32.508885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:32.516634 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:32.517097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:32.517889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:32.518341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:32.857352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ffcb2b9c-ffcf-4c99-8785-a5077058e5b7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353626 May 20 09:16:32.858104 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 226/482] 10.222.0.69 () {62 vars in 1363 bytes} [Fri May 20 09:16:32 2022] POST /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:16:33.002737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:33.003390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:33.017600 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:33.018048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:33.019024 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:33.019543 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:33.132616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f9e77d43-8d72-4e28-803e-a380040936fa tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/action" status: 202 len: 0 microversion: 2.20 time: 0.141044 May 20 09:16:33.133440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 257/483] 10.222.0.69 () {62 vars in 1318 bytes} [Fri May 20 09:16:32 2022] POST /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 20 09:16:33.143298 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:33.144926 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:33.149794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:33.160582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:33.161124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:33.162029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:33.162516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:33.316354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:33.327686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:33.329977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:33.331805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5f61ac4a-53bd-4afb-acdd-e0e33931801b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.193935 May 20 09:16:33.332647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 227/484] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:33 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:34.351941 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:34.352508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:34.359031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:34.359517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:34.360284 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:34.360717 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:34.509482 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:34.519350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:34.520941 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:34.522488 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-09bb7c0f-0cbe-4857-a2a2-19b593e7ca8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.175117 May 20 09:16:34.523176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 258/485] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:34 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:35.542302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:35.542868 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:35.550334 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:35.550771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:35.551593 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:35.552021 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:35.696705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:35.706414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:35.708262 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:35.709589 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c176638a-95e6-479c-be09-cd6c10a65bbb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.171426 May 20 09:16:35.710460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 228/486] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:35 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:36.730469 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:36.731028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:36.738136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:36.738585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:36.739376 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:36.739808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:36.884521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:36.893153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:36.894648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:36.895837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1059dd39-59a3-44dc-b436-a17cf21eb7f7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.169510 May 20 09:16:36.896747 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 259/487] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:36 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:37.916825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:37.917444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:37.926026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:37.926468 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:37.927224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:37.927685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:38.067231 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:38.076427 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:38.077947 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:38.079175 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5db864f0-b059-450b-b4e9-47952625d4c1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.168660 May 20 09:16:38.079901 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 229/488] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:37 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:39.098972 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:39.099727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:39.109203 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:39.109948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:39.110977 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:39.111589 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:39.247006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:39.255961 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:39.257463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:39.258625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e6f388df-3ab0-4edc-b706-e1e1b88134a9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.164813 May 20 09:16:39.259189 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 260/489] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:39 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:40.280084 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:40.280925 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:40.283442 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:40.291977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:40.292599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:40.293656 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:40.294270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:40.442326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:40.451843 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:40.453331 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:40.454492 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-baf1b3a5-8511-402f-8e38-0566aed33cf4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.180049 May 20 09:16:40.455039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 230/490] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:40 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:41.472583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:41.473203 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:41.480220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:41.480698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:41.481468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:41.481905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:41.615174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:41.624148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:41.625605 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:41.626796 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-71299c0f-8a32-4b1e-abbd-9a0d95bb7b44 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.158255 May 20 09:16:41.627470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 261/491] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:41 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:42.644687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:42.645243 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:42.652711 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:42.653180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:42.653922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:42.654350 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:42.798169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:42.806543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:42.808050 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:42.809187 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-78a5bc73-66c6-4ed2-9bc9-65d181d72a24 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.168512 May 20 09:16:42.809737 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 231/492] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:42 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:43.828271 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:43.828868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:43.835938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:43.836377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:43.837125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:43.837590 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:43.975131 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:43.983802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:43.985299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:43.986441 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1f43e05d-9ee1-4ef0-94ec-65706e3f31c3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.162104 May 20 09:16:43.987012 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 262/493] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:43 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:45.009090 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:45.009638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:45.016524 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:45.016960 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:45.017707 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:45.018129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:45.159739 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:45.169684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:45.171153 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:45.172343 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-12d5c59f-8d11-40db-be88-ea1d1eaf0a94 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.169782 May 20 09:16:45.173140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 232/494] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:45 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:46.195018 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:46.195917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:46.203683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:46.204125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:46.204894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:46.205357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:46.207911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:46.346667 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:46.358637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:46.360357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:46.361550 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-da7a7f9f-d17c-45b7-91d7-e48ea883095f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.173404 May 20 09:16:46.362122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 263/495] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:46 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:47.383248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:47.384106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:47.391034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:47.391549 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:47.392342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:47.392792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:47.540221 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:47.549473 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:47.550963 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:47.552404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2b35a253-62c8-46c4-8cae-2467d8a3358d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1749 microversion: 2.20 time: 0.175128 May 20 09:16:47.552965 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 233/496] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:47 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:48.572622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:48.573281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:48.580546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:48.580963 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:48.581717 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:48.582147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:48.718200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:48.727005 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:48.728542 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:48.729750 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-df90b40f-43dc-41e9-9228-3f0ee42a5d1d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1751 microversion: 2.20 time: 0.163292 May 20 09:16:48.730300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 264/497] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:48 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:49.752386 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:49.752996 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:49.760352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:49.760830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:49.761572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:49.762004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:49.965832 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:49.977251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:49.979531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:49.980723 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-24b8e299-a387-486d-8533-14d91675eec1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.234888 May 20 09:16:49.981254 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 234/498] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:49 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:51.006207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:51.009285 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:51.026055 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:51.026802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:51.027770 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:51.028353 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:51.250141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:51.259564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:51.261336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:51.262725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ffdaf34a-ced7-42eb-af99-f7b6ffafff8f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.266522 May 20 09:16:51.264023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 265/499] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:50 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:52.285848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:52.286457 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:52.296325 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:52.300603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:52.303880 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:52.304845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:52.438963 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:52.454811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:52.456307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:52.457718 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e673d0b3-e05a-41e6-b6ef-5d535d264907 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.176082 May 20 09:16:52.458363 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 235/500] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:52 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:53.477590 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:53.480171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:53.488552 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:53.489841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:53.491083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:53.491749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:53.616682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-392693727", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-276577009", "security_groups": [{"name": "tempest-secgroup-smoke-447532997"}], "block_device_mapping_v2": [{"uuid": "d8cc55b6-34aa-451c-b131-6827f8273d44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f48dba5-6c8f-4717-93d6-9f60508a64db"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:53.659864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:53.668874 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:53.670461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:53.671735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ac3eadaf-9f5b-4e9a-ae22-0db76e05fa92 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.199198 May 20 09:16:53.672639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 266/501] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:53 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:53.726708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] validate_networks() for [('5f48dba5-6c8f-4717-93d6-9f60508a64db', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:16:54.117855 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:16:54.118285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:16:54.118760 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:16:54.119169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:16:54.119622 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:16:54.128726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:54.129210 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:54.130006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:54.130443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:54.148397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for project f26ac8782fe0407cb6f146ba70e74246. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:16:54.155345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for user bc0307909d614a1f97f006dc6d091cd4 and project f26ac8782fe0407cb6f146ba70e74246. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:16:54.219394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:16:54.221553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8cc55b6-34aa-451c-b131-6827f8273d44',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:16:54.357227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-494e7c27-0311-45ae-92b4-919e91bb423b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744679 May 20 09:16:54.358108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 236/502] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:16:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 20 09:16:54.368699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-206fd69f-5d9b-45ba-92fe-e3c849aa5066 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:54.369210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-206fd69f-5d9b-45ba-92fe-e3c849aa5066 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:54.428996 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-206fd69f-5d9b-45ba-92fe-e3c849aa5066 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:54.435799 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-206fd69f-5d9b-45ba-92fe-e3c849aa5066 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1093 microversion: 2.1 time: 0.071128 May 20 09:16:54.436356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 267/503] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:54 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:54.691171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:54.691948 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:54.698938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:54.699505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:54.700508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:54.701095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:54.835897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:54.838119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:16:54.845830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:54.847326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:54.848539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ae70c150-c4bf-4d6d-98be-f3ac6c2ea6f9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.162091 May 20 09:16:54.849091 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 237/504] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:54 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:55.452874 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:55.453433 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:55.460270 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:55.460850 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:55.461448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:55.461873 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:55.521708 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:55.529271 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d44a1a64-ccfe-4a41-af47-27fade44a3b9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.080310 May 20 09:16:55.529784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 268/505] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:55 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:55.866489 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:55.867095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:55.874928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:55.875447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:55.876203 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:55.876629 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:56.016833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:56.026977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:56.028525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:56.029690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-99261ab1-7e77-47fe-b56b-8499742f0823 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.167534 May 20 09:16:56.030252 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 238/506] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:55 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:56.550422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:56.551360 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:56.559002 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:56.559543 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:56.560395 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:56.560872 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:56.628393 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:56.636275 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5efeefc7-ac8b-49e5-804c-7258d9b32f2e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.092560 May 20 09:16:56.636838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 269/507] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:56 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:57.047839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:57.048439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:57.055454 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:57.055893 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:57.056645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:57.057065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:57.195603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:57.204061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:57.205564 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:57.206729 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f9cb684f-4ad9-4bd3-a9f7-8a2412fa056f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.162763 May 20 09:16:57.207364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 239/508] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:57 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:57.653514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:57.654163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:57.661129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:57.661571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:57.662327 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:57.662760 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:57.728227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:57.736217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c2f3e1e6-e6f7-47ae-ba4c-86db5d33f7ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.086752 May 20 09:16:57.736784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 270/509] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:57 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:58.227227 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:58.228755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:58.237479 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.238281 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.239326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.240127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.311158 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:58.311694 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:58.322257 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.322711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.323767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.324200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.351068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-adbac99e-1bc1-44b6-83eb-e19c8b7f3d18 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/ips" status: 200 len: 148 microversion: 2.1 time: 0.043780 May 20 09:16:58.351685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 271/510] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:16:58 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:16:58.362890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f5e780-f5b5-441f-9abe-81f9965a71ae"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:16:58.371502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:58.371502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.371502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.371502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.371893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.397497 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:58.406114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:58.407816 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:58.408761 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9c3a9f76-4112-400f-a95b-de250d2df857 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.188124 May 20 09:16:58.409311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 240/511] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:58 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:58.452090 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Invalid volume: volume 65f5e780-f5b5-441f-9abe-81f9965a71ae is already attached to instances: 121038e6-7ba5-4d8f-b099-53e27cc913c6 May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: POST /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/os-volume_attachments HTTP/1.1 May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 74 May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:16:58.454031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {"volumeAttachment": {"volumeId": "65f5e780-f5b5-441f-9abe-81f9965a71ae"}} May 20 09:16:58.455793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Invalid volume: volume 65f5e780-f5b5-441f-9abe-81f9965a71ae is already attached to instances: 121038e6-7ba5-4d8f-b099-53e27cc913c6 May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'server_id': 'cd40b569-94f7-46ca-9c6e-9fce603f84a6', 'body': {'volumeAttachment': {'volumeId': '65f5e780-f5b5-441f-9abe-81f9965a71ae'}}} May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65f5e780-f5b5-441f-9abe-81f9965a71ae is already attached to instances: 121038e6-7ba5-4d8f-b099-53e27cc913c6 May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:16:58.456905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65f5e780-f5b5-441f-9abe-81f9965a71ae is already attached to instances: 121038e6-7ba5-4d8f-b099-53e27cc913c6 May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:16:58.458313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65f5e780-f5b5-441f-9abe-81f9965a71ae is already attached to instances: 121038e6-7ba5-4d8f-b099-53e27cc913c6 May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 400 to user: Invalid volume: volume 65f5e780-f5b5-441f-9abe-81f9965a71ae is already attached to instances: 121038e6-7ba5-4d8f-b099-53e27cc913c6 {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e31f5b89-262f-44ef-9c80-59e57c9e8a98 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097109 May 20 09:16:58.459854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 272/512] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:16:58 2022] POST /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 20 09:16:58.464545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:58.465043 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:58.471072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.471546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.472310 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.472801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.497838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:16:58.585567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a7f79f0d-78af-4417-b52c-a51d8c1274fa tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 204 len: 0 microversion: 2.1 time: 0.124262 May 20 09:16:58.586279 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 241/513] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:16:58 2022] DELETE /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 20 09:16:58.599686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:58.600380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:58.607447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.607952 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.608990 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.609636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.751822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:58.760964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5b8479b0-5ea8-49a4-a563-6ae4189cfe4a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.167362 May 20 09:16:58.761536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 273/514] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:58 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:58.762757 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:58.763484 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:58.771302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.773998 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.774587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:58.775016 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:58.851004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:58.859082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9bad23bc-aa39-4e42-9097-52472ef4c535 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.100638 May 20 09:16:58.865715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 242/515] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:58 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:59.425968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:59.426569 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:59.432534 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:59.432973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:59.433702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:59.434129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:59.575459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:59.585630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:59.587396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:59.588783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2c21fda0-5ca7-4998-86ef-ab1709a7eb06 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.166819 May 20 09:16:59.589343 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 274/516] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:16:59 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:16:59.779809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:59.780399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:59.787154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:59.787637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:59.788392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:59.788825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:59.876192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:16:59.876865 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:16:59.883685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:59.884130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:59.884902 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:16:59.885307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:16:59.928496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:59.936223 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e944feb6-1342-4cc0-ad25-6a4dcddfb46a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.160326 May 20 09:16:59.936888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 243/517] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:59 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:16:59.946688 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:16:59.954323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1cfe5933-391a-4877-8f63-e7de6654aa50 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.082085 May 20 09:16:59.954872 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 275/518] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:16:59 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:00.607756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:00.611168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:00.617796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:00.618248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:00.619335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:00.619774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:00.782143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:00.792989 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:00.794927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:00.796206 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6a926e53-8b3b-41fd-8b5e-8d4af992fc6f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.192789 May 20 09:17:00.796829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 244/519] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:00 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:00.953410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:00.954073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:00.955910 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=46 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:00.961019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:00.961453 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:00.962204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:00.962625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:00.972328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:00.972898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:00.984055 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:00.985263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:00.986291 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:00.987013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:01.069124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:01.077696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8002ecee-d1d3-4fde-8d3b-5e6bfa14569c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.110390 May 20 09:17:01.078684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 245/520] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:00 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:01.191061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:01.198707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a22ed22b-b53e-40bf-9c29-47417b1727e8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.249328 May 20 09:17:01.199306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 276/521] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:00 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:01.815906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:01.816590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:01.823456 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:01.823898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:01.824654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:01.825082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:01.986894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:01.995931 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:01.997428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:01.998592 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2293a4a5-6396-49b8-8482-00aca9bc66b1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.186745 May 20 09:17:01.999151 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 246/522] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:01 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:02.099476 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:02.100057 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:02.106859 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:02.107455 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:02.108521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:02.108948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:02.205114 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:02.213375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c973fa1b-4307-4cf6-a8dd-f7411f82dc90 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.120656 May 20 09:17:02.214217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 277/523] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:02 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:02.224609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:02.225307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:02.231856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:02.232321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:02.233091 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:02.233522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:02.366170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:02.377801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e5920211-c6ec-4240-95c5-f37023e32bc4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.164522 May 20 09:17:02.378404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 247/524] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:02 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:03.016992 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:03.017630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:03.026694 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:03.027213 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:03.028431 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:03.029058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:03.201828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:03.210475 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:03.212032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:03.213192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b41c87c4-541b-4b32-9d3c-2aee8365e23f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.200229 May 20 09:17:03.213778 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 278/525] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:03 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:03.230106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:03.230716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:03.233190 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:03.238796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:03.239460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:03.240242 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:03.240944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:03.309047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:03.319225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4f7e93cb-4dbd-4ad8-a4e6-9fcca57d6aec tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.092646 May 20 09:17:03.325052 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 248/526] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:03 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:03.397858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:03.398763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:03.405410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:03.405885 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:03.406686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:03.407134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:03.621033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:03.638136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-55eb1e3f-2203-4f50-a467-d63693c59a97 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.245270 May 20 09:17:03.663036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 279/527] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:03 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:04.231667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:04.232254 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:04.233997 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:04.234646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:04.241147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:04.241618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:04.242359 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:04.242787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:04.337197 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:04.337804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:04.344396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:04.344844 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:04.345634 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:04.346065 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:04.381162 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:04.390131 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:04.391688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:04.392887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d02edaf1-d7b7-419f-8d00-f77ff5172c35 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.165352 May 20 09:17:04.393445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 249/528] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:04 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:04.408059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:04.415686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3e291efa-480e-4e50-a5bd-193d8ae57e6b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.082321 May 20 09:17:04.416248 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 280/529] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:04 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:04.673566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:04.674567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:04.682102 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:04.682532 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:04.683282 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:04.683749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:04.828682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:04.837459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-21b27903-788c-46eb-97ec-41d17b7ef4d2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.170257 May 20 09:17:04.837995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 250/530] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:04 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:05.412519 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:05.413123 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:05.414935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:05.420937 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.421382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.422144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.422539 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.425256 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:05.433007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:05.433679 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:05.440263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.440709 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.441467 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.441956 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.503973 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:05.511830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6c56cf29-bee7-4aad-bbe6-3ec675f5a107 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1143 microversion: 2.1 time: 0.082746 May 20 09:17:05.512404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 251/531] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:05 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:05.550574 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:05.559599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:05.561108 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:05.562285 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b59bd1d6-4880-4954-96a2-2209022a9ad1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.154683 May 20 09:17:05.562841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 281/532] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:05 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:05.618230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d663907c-27e8-482c-bc3a-f217e1b82622"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:05.619398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:05.625941 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.626385 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.627130 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.627590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.704912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:05.858888 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:05.859936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:05.870204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.870956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:05.872275 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:05.872999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:06.009956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:06.017636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-995c0aee-e2d7-4b55-a994-8dba61fea402 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.165220 May 20 09:17:06.018443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 282/533] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:05 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:06.533251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:06.534308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:06.542019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:06.542467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:06.543228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:06.543693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:06.605258 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:06.613155 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-96ff0725-bb02-4a92-b24f-d73939226823 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1135 microversion: 2.1 time: 0.086426 May 20 09:17:06.613761 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 283/534] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:06 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1135 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:06.618293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:06.618868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:06.624931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:06.625391 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:06.626152 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:06.626593 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:06.772998 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fe61c555-51e4-4154-9c02-563ab94b95d8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158426 May 20 09:17:06.780354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 252/535] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:17:05 2022] POST /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments => generated 194 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:06.785301 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:06.794986 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:06.796805 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:06.798141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-96d32c7c-8fb7-432a-927e-244f7b9c9d0e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.183440 May 20 09:17:06.810300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 284/536] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:06 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:07.036271 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:07.036910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:07.043998 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:07.044506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:07.045284 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:07.045720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:07.382829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:07.390695 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-54281186-aacb-47c9-af57-8a143f2a1d64 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1679 microversion: 2.1 time: 0.358807 May 20 09:17:07.391293 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 253/537] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:07 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:07.630681 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:07.631334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:07.638338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:07.638795 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:07.639590 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:07.640023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:07.708522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:07.716789 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5d0dc210-dcad-4c04-a698-04dc57179844 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1209 microversion: 2.1 time: 0.089466 May 20 09:17:07.716975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 285/538] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:07 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:07.817301 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:07.818177 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:07.824674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:07.825217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:07.826037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:07.826885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.125098 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:08.134090 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:08.135731 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:08.137114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5a36188f-752b-4e81-9017-b94f92aa0bba tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.324046 May 20 09:17:08.137769 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 254/539] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:07 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:08.408937 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:08.409882 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:08.416644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.417083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.417832 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.418255 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.487730 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:08.496448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8a8cf1d5-6c8c-4fe2-b2fe-aaf9dc905ee9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 200 len: 1611 microversion: 2.1 time: 0.091577 May 20 09:17:08.497371 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 286/540] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:08 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 1611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:08.508847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-a8c92641-0e5d-44c2-9d00-265afaa722e4 req-7ae0f2c7-8f52-40cb-a01e-d84490d22cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd40b569-94f7-46ca-9c6e-9fce603f84a6", "name": "network-vif-deleted", "tag": "1d0fae47-b7b6-4830-9f35-b102d70a7a40"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:08.522168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a8c92641-0e5d-44c2-9d00-265afaa722e4 req-7ae0f2c7-8f52-40cb-a01e-d84490d22cb1 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.523025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a8c92641-0e5d-44c2-9d00-265afaa722e4 req-7ae0f2c7-8f52-40cb-a01e-d84490d22cb1 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.537590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-a8c92641-0e5d-44c2-9d00-265afaa722e4 req-7ae0f2c7-8f52-40cb-a01e-d84490d22cb1 service nova] Creating event network-vif-deleted:1d0fae47-b7b6-4830-9f35-b102d70a7a40 for instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 on hv-cinder-83699 May 20 09:17:08.543795 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-a8c92641-0e5d-44c2-9d00-265afaa722e4 req-7ae0f2c7-8f52-40cb-a01e-d84490d22cb1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044694 May 20 09:17:08.545732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 255/541] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:08.593080 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:08.593686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:08.605433 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.611297 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.612325 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.612909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.737039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:08.737757 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:08.745456 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.745905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.748047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:08.748486 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:08.836259 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lazy-loading 'services' on Instance uuid e99280ff-b8f3-420b-ba9a-e6e5686de569 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:17:08.984955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:08.993719 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4e5044c9-26f4-467e-8259-59c0f018c409 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1276 microversion: 2.1 time: 0.263693 May 20 09:17:08.999425 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 256/542] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:08 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:09.080627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e3b0744e-4424-406e-b79a-6b42fc2f23f2 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-volume_attachments/d9c1e5cd-a911-44ee-8f45-9edf6f4fd693" status: 202 len: 0 microversion: 2.1 time: 0.492170 May 20 09:17:09.082535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 287/543] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:17:08 2022] DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-volume_attachments/d9c1e5cd-a911-44ee-8f45-9edf6f4fd693 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:17:09.158937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:09.159790 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:09.171703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:09.172156 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:09.172932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:09.174737 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:09.424638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:09.438111 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:09.440085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:09.441428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ac0fd110-9c0a-451b-8251-b18da152d498 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.288651 May 20 09:17:09.444060 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 257/544] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:09 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:09.518251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:09.518959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:09.526710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:09.527152 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:09.540580 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:09.541217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:09.558995 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 HTTP/1.1 May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:17:09.560913 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:17:09.562533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'cd40b569-94f7-46ca-9c6e-9fce603f84a6'} May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:17:09.563687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:17:09.565303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:09.567957 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:17:09.569072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ed935056-f881-402f-989f-938b6d07b1f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 404 len: 111 microversion: 2.1 time: 0.058435 May 20 09:17:09.570249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 288/545] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:09 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:17:09.581321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-58ede4dc-b4f5-4cc0-87c7-d09ddadd4a95 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '.version_select at 0x7f7c876473a0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:09.615962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-58ede4dc-b4f5-4cc0-87c7-d09ddadd4a95 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-557494562" status: 202 len: 0 microversion: 2.1 time: 0.041229 May 20 09:17:09.616959 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 258/546] 10.222.0.69 () {58 vars in 1217 bytes} [Fri May 20 09:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-557494562 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:17:10.010649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:10.011895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:10.024111 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.024738 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.025659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.026237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.300498 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:10.308562 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-18b7d283-b96d-4924-bc49-adc5ce24f873 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1276 microversion: 2.1 time: 0.301917 May 20 09:17:10.320042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 289/547] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:10 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1276 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:10.464197 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:10.466234 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:10.481606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.483572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.484540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.486156 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.591918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-ded8d3c6-0988-4bc1-8909-ba663fbbf6af req-96e336fd-9062-4639-a147-27ff1802c28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724e6ca0-78af-4670-a409-d2ee15ebf3d4", "tag": "9b807888-e022-4e95-89be-56a386f87d4b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:10.611014 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-ded8d3c6-0988-4bc1-8909-ba663fbbf6af req-96e336fd-9062-4639-a147-27ff1802c28f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.611709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-ded8d3c6-0988-4bc1-8909-ba663fbbf6af req-96e336fd-9062-4639-a147-27ff1802c28f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.627357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-ded8d3c6-0988-4bc1-8909-ba663fbbf6af req-96e336fd-9062-4639-a147-27ff1802c28f service nova] Creating event network-changed:9b807888-e022-4e95-89be-56a386f87d4b for instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 on hv-cinder-83699 May 20 09:17:10.634333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-ded8d3c6-0988-4bc1-8909-ba663fbbf6af req-96e336fd-9062-4639-a147-27ff1802c28f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052976 May 20 09:17:10.635497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 290/548] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:17:10.668235 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:10.675649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:10.676483 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:10.677798 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:10.679512 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:10.681226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-36c4a866-b28e-41de-a7dd-52896bcefcb9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.222611 May 20 09:17:10.682531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 259/549] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:10 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:10.685220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.686401 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.687385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.690841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.787074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lazy-loading 'services' on Instance uuid 121038e6-7ba5-4d8f-b099-53e27cc913c6 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:17:10.863517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a31bd499-2ecb-46fd-9d54-09a4a6ccd4da tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments/65f5e780-f5b5-441f-9abe-81f9965a71ae" status: 202 len: 0 microversion: 2.1 time: 0.191832 May 20 09:17:10.864147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 291/550] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:17:10 2022] DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments/65f5e780-f5b5-441f-9abe-81f9965a71ae => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 20 09:17:10.872966 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:10.873875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:10.880906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.881259 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.882027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:10.882457 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:10.915497 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-99445d9f-e8ad-4fe7-a2c7-02314e614dd1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 May 20 09:17:10.916077 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 260/551] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:17:10 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:11.326805 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:11.330301 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:11.336857 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:11.337306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:11.338061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:11.338683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:11.481212 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:11.489175 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-806ed14a-4ccc-48c6-ac3d-3e8ad770557e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1276 microversion: 2.1 time: 0.167081 May 20 09:17:11.489730 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 292/552] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:11 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:11.704261 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:11.705192 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:11.713344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:11.713789 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:11.714549 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:11.714968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:11.849822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:11.858812 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:11.860347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:11.861554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-de623433-b682-477b-8920-4e6ae4b39179 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.163897 May 20 09:17:11.862369 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 261/553] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:11 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:11.929376 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:11.930361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:11.936481 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:11.936968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:11.937671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:11.938109 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:11.966791 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6c5223f1-d902-4d5d-ab7e-44f3bcc0a0cd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 May 20 09:17:11.967367 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 293/554] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:17:11 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:12.506134 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:12.506736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:12.513268 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:12.513709 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:12.514479 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:12.514906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:12.645226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:12.658649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-29a5a283-b5bb-49a1-9b14-847362789aae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1276 microversion: 2.1 time: 0.156284 May 20 09:17:12.659218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 262/555] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:12 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:12.884528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:12.885351 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:12.896709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:12.897464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:12.898694 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:12.899455 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:12.978746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:12.980466 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:12.987803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:12.988108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:12.988807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:12.989451 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:13.030367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8b3ce7fb-2c45-4047-91ab-42c6764696ab tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055591 May 20 09:17:13.030848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 263/556] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:17:12 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:13.049699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:13.061077 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:13.062560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:13.063753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-35d02b0f-c43f-431e-bfa5-ced8476ad0d6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.186246 May 20 09:17:13.064316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 294/557] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:12 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:13.679977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:13.680508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:13.686683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:13.687127 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:13.687910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:13.688336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:13.830074 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:13.838077 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-743c653b-58a1-4aa6-8b33-be462fd7fa79 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1276 microversion: 2.1 time: 0.164369 May 20 09:17:13.838653 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 264/558] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:13 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:14.045594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:14.047096 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:14.057675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.058355 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.059558 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.060209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.089482 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:14.090057 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:14.095003 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-81dbe9c6-c1dd-4938-ad6c-a5c22d7e6b49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055505 May 20 09:17:14.095527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 295/559] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:17:14 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:14.096701 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.097154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.097919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.098409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.229872 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:14.238595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:14.240130 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:14.241503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-afcd134a-02c9-4e1d-991e-d3665e22e510 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.156056 May 20 09:17:14.242418 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 265/560] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:14 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:17:14.418529 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:14.419591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:14.425914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.426356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.427097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.427558 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.449900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lazy-loading 'flavor' on Instance uuid d6bf483f-196d-4699-8ca8-968382aecdac {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:17:14.537440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:14.590410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f149ac52-3d1b-4e1f-b316-4dd87e713acb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/action" status: 200 len: 32 microversion: 2.1 time: 0.175915 May 20 09:17:14.591036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 296/561] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:17:14 2022] POST /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:17:14.600260 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:14.600867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:14.607188 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.607654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.608416 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.608847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.838876 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:14.851735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-907cdf8e-21f7-47b9-9aec-58486f96b420 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.253144 May 20 09:17:14.853136 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 266/562] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:14 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:14.856784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:14.857692 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:14.865748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.866397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:14.867385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:14.867993 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.009659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:15.017573 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-886f86fe-b35e-411f-9d31-eda967564d44 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.165687 May 20 09:17:15.018143 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 297/563] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:14 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:15.107909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:15.109021 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:15.116687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.117170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.118641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.119159 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.162087 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-807f0450-bc07-4544-85cb-1dc68eb90632 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058923 May 20 09:17:15.163023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 267/564] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:17:15 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:15.261145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:15.261868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:15.268627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.269344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.270103 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.270883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.413958 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:15.422898 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:15.424524 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:15.425688 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-da6c06f1-7951-4f2e-8203-d714511ccaee tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.169621 May 20 09:17:15.426334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 298/565] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:15 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:15.631394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c3228abd-03d1-45b8-8708-1c3fe03a773e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:15.637854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3228abd-03d1-45b8-8708-1c3fe03a773e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.638455 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3228abd-03d1-45b8-8708-1c3fe03a773e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.663487 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c3228abd-03d1-45b8-8708-1c3fe03a773e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Going to try to stop instance {{(pid=117981) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 20 09:17:15.699727 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:15.710146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c3228abd-03d1-45b8-8708-1c3fe03a773e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action" status: 202 len: 0 microversion: 2.1 time: 0.084844 May 20 09:17:15.710796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 268/566] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:17:15 2022] POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:17:15.718914 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:15.719517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:15.726248 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.726683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.727691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.728121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.858653 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:15.866419 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d5e313e3-0622-479b-963d-8a128eff528f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.151196 May 20 09:17:15.867081 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 299/567] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:15 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:15.870397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:15.871085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:15.877760 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.878198 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:15.878955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:15.879415 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.007876 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:16.016380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f093704c-75f1-4515-8cf6-312fc73ba1b9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.150728 May 20 09:17:16.016952 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 269/568] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:15 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:16.034517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:16.035163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:16.041463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.041904 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.042649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.043072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.173928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:16.174967 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:16.181784 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.182194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.182943 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.183405 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.186987 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:16.194946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-96e689d4-b6a7-49a7-a07b-396579c9ec7d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.164269 May 20 09:17:16.195597 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 300/569] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:16 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:16.213337 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c952de93-4c59-4a6f-ad23-b0c1679135a2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043357 May 20 09:17:16.213884 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 270/570] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:17:16 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:17:16.271766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:16.272263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:16.279016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.279509 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.280266 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.280700 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.305639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:17:16.399967 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-78dcf740-6884-4be1-b94f-7c8fa84c2222 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 204 len: 0 microversion: 2.1 time: 0.132013 May 20 09:17:16.400497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 301/571] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:17:16 2022] DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:17:16.409031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:16.409640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:16.415704 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.416129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.416867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.417289 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.447172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:16.447918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:16.454487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.454923 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.455722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.456141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.550360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:16.558166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-de84123b-b131-4905-bca8-3d30aeba316d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1680 microversion: 2.1 time: 0.153017 May 20 09:17:16.558707 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 271/572] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:16 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:16.586519 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:16.595186 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:16.596704 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:16.597861 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5d0f516e-d9c0-484a-83f1-0c6f0514d037 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.155130 May 20 09:17:16.598420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 302/573] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:16 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:16.881981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6dbc821a-ad42-4a4d-917e-056df92c01f3 req-7e5e7128-3e87-400a-9e58-58eedce8d8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "name": "network-vif-plugged", "status": "completed", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:16.884832 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:16.885448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:16.892784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.893333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.894299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.894737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.905071 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6dbc821a-ad42-4a4d-917e-056df92c01f3 req-7e5e7128-3e87-400a-9e58-58eedce8d8ee service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:16.905481 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6dbc821a-ad42-4a4d-917e-056df92c01f3 req-7e5e7128-3e87-400a-9e58-58eedce8d8ee service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:16.917517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6dbc821a-ad42-4a4d-917e-056df92c01f3 req-7e5e7128-3e87-400a-9e58-58eedce8d8ee service nova] Creating event network-vif-plugged:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:17:16.922100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6dbc821a-ad42-4a4d-917e-056df92c01f3 req-7e5e7128-3e87-400a-9e58-58eedce8d8ee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044153 May 20 09:17:16.922919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 272/574] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:17.032032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.034701 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:17.035427 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:17.039939 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-725a0981-be35-482e-8548-1d20bb6be2dd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.159562 May 20 09:17:17.040709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 303/575] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:16 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:17.041892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.042345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.043109 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.043570 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.193338 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.203705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a49bb36e-41b8-4b80-8ff1-57620469efef tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.172897 May 20 09:17:17.204289 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 273/576] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:17 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:17.211412 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:17.212092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:17.221057 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.221781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.222758 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.223347 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.354996 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.366510 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-74e42d2a-e35c-4d77-ba2f-e1a66ff6db82 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.158691 May 20 09:17:17.367296 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 304/577] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:17 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:17.579739 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:17.580672 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:17.588767 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.589219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.589946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.590411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.617545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:17.618349 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:17.624782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.625300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.626063 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:17.626494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:17.718946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.726780 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9c290b70-1837-476c-9e6f-f2448cc19d6a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1680 microversion: 2.1 time: 0.153783 May 20 09:17:17.727557 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 274/578] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:17 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:17.754748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.763367 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.764883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:17.766006 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ff2ab17b-e7e9-4916-b9c1-06e386987e3a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.153095 May 20 09:17:17.766598 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 305/579] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:17 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:18.061670 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:18.062667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:18.071433 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.071878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.072633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.073059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.215045 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:18.221126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:18.221734 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:18.222798 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f798efc8-180d-4d9f-be62-def3ac3494e8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.167701 May 20 09:17:18.223563 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 275/580] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:18 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:18.228211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.228660 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.229430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.229848 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.372783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:18.381209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-220fd92b-ff0c-4d6f-b3dc-b67202d92469 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.163920 May 20 09:17:18.381876 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 306/581] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:18 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:18.390849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:18.390849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:18.390849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.390849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.391587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.392012 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.683627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:18.692195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-788a4d5a-96f6-4e43-a2f2-acd067ee4f49 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.312182 May 20 09:17:18.692769 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 276/582] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:18 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:18.744365 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:18.744994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:18.753396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.754039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.754836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.755283 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.784860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:18.785473 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:18.791778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.792229 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.793099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:18.793589 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:18.886927 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:18.894684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-90565c91-a5eb-4c83-942b-04fe0db50ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1680 microversion: 2.1 time: 0.154325 May 20 09:17:18.895692 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 307/583] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:18 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:19.026393 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.035181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.036734 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.037870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c5bfc30d-c32b-438f-b77b-251e7d12a709 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.257172 May 20 09:17:19.038462 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 277/584] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:18 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:17:19.239916 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:19.240663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:19.247134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.247475 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.248216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.248643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.383378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.390902 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-90deb1d3-9210-427b-ba95-e8cb516cccda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.155043 May 20 09:17:19.391901 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 308/585] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:19 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:19.398349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:19.399540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:19.406157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.406616 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.407421 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.407853 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.709512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:19.710512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:19.717509 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.718046 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.718869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.719934 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.846946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.855095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-657c1cc6-01d5-4198-9670-775810b52f5b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.460959 May 20 09:17:19.855696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 278/586] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:19 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:19.860412 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b2b90798-286b-44f1-9fa4-598d440b52de req-d6b10298-8742-4a63-96cd-3a5f1ef5a477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121038e6-7ba5-4d8f-b099-53e27cc913c6", "name": "network-vif-deleted", "tag": "10b699e9-683d-4dd6-90dd-b78af5111278"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:19.867253 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.871094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b2b90798-286b-44f1-9fa4-598d440b52de req-d6b10298-8742-4a63-96cd-3a5f1ef5a477 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.871805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b2b90798-286b-44f1-9fa4-598d440b52de req-d6b10298-8742-4a63-96cd-3a5f1ef5a477 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.875043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8c28c7c5-e092-40b3-9ccd-88583db00180 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.169582 May 20 09:17:19.884247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 309/587] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:19 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:19.884535 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b2b90798-286b-44f1-9fa4-598d440b52de req-d6b10298-8742-4a63-96cd-3a5f1ef5a477 service nova] Creating event network-vif-deleted:10b699e9-683d-4dd6-90dd-b78af5111278 for instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 on hv-cinder-83699 May 20 09:17:19.889404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b2b90798-286b-44f1-9fa4-598d440b52de req-d6b10298-8742-4a63-96cd-3a5f1ef5a477 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032389 May 20 09:17:19.889994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 279/588] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:19.912282 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:19.912919 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:19.919214 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.919687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.920436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:19.920860 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:19.981261 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:19.983649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:19.990170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-85ddc2c5-7186-40ef-be98-7029ce27901a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1613 microversion: 2.1 time: 0.081750 May 20 09:17:19.990816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 310/589] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:19 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1613 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:20.060251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:20.060859 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:20.067219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.067702 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.068459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.068932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.209003 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:20.217839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:20.219435 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:20.220975 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-15498031-5153-4f13-872e-da559993f55c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.164973 May 20 09:17:20.221579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 280/590] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:20 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:20.408637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:20.409249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:20.417043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.417512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.418343 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.418928 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.569463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:20.579936 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-28dc72dc-8683-4479-aa6f-9e060ea15d54 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.175212 May 20 09:17:20.580514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 311/591] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:20 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:20.872039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:20.872654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:20.879987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.880458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.881297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.881729 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.891613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:20.892144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:20.902783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.903224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:20.904046 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:20.904476 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.029758 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.042606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-534b598a-e00f-415a-9caf-40035b1420d2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.173765 May 20 09:17:21.044226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 281/592] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:20 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:21.050072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.061007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:21.063882 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ab825826-d1cd-4b0b-aa3e-dcc1d2f20d94 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.176247 May 20 09:17:21.064455 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 312/593] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:20 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:21.065065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:21.073339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:21.074496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.075397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:21.076509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.145907 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.153585 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2623acce-f460-4a9b-b991-db84c7719b29 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 200 len: 1325 microversion: 2.1 time: 0.108038 May 20 09:17:21.154154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 282/594] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:21 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 1325 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:21.240109 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:21.240764 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:21.247149 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:21.247639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.248396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:21.248826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.381601 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.390127 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.391653 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.392823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-af60f559-b5ab-4c76-8867-6babe7cd0b60 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1807 microversion: 2.20 time: 0.157010 May 20 09:17:21.393365 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 313/595] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:21 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:21.601026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:21.601815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:21.609926 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:21.610481 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.611585 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:21.612140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:21.750673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:21.758360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6d94109a-f7a7-40ef-9401-8fd9c093ade4 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.163790 May 20 09:17:21.759002 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 283/596] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:21 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:22.064735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:22.065830 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:22.077085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.077829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.079084 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.079938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.085120 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:22.085700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:22.092664 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.093110 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.093870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.094306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.210060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:22.218202 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-71571b4e-0508-4fb9-aaf0-6124976a3b4b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.160102 May 20 09:17:22.218817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 314/597] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:22 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:22.224155 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:22.231349 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:22.231654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a9041f81-721d-4b56-9aba-847ab75e035d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.152999 May 20 09:17:22.232028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:22.232216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 284/598] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:22 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:22.238085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.238521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.239299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.239727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.252810 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 HTTP/1.1 May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:17:22.254430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:17:22.255931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '121038e6-7ba5-4d8f-b099-53e27cc913c6'} May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:17:22.256905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:17:22.258460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:17:22.260206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:17:22.260206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-22286661-91ec-4dec-a0a5-8a6d8e676ed4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 404 len: 111 microversion: 2.1 time: 0.035893 May 20 09:17:22.260206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 315/599] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:22 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:17:22.266787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eb99efa5-1db4-44be-b3bc-630a605def1a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '.version_select at 0x7f7c87647790>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:22.291043 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eb99efa5-1db4-44be-b3bc-630a605def1a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867156308" status: 202 len: 0 microversion: 2.1 time: 0.030262 May 20 09:17:22.291642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 285/600] 10.222.0.69 () {58 vars in 1220 bytes} [Fri May 20 09:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867156308 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:17:22.412372 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:22.413045 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:22.419420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.419931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.420749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.421177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.689457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:22.698140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:22.699656 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:22.700815 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-71bb264c-8e82-4a95-8b18-dd5f51e1a679 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1794 microversion: 2.20 time: 0.292464 May 20 09:17:22.701364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 316/601] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:17:22 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1794 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:17:22.780910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:22.781882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:22.790164 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.790890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.792036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:22.792536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:22.941272 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:22.949407 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9d97dade-d41b-460f-b785-16839f0e6fda tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.176497 May 20 09:17:22.959376 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 286/602] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:22 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:23.005760 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9de9139a-1401-49de-9641-66eb7a2a1050 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: .version_select at 0x7f7c86d0d9d0>, body: {"keypair": {"name": "tempest-keypair-968254911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICt+ivFG7pqGWWPav4DLELvGqPbJPvhandskdh6VfcBE9E6H4TFZZrZlOftsVjBSqZSmaZLVpgjRwHOyHZMUFFZGyEzIMFTPxee0GqwHe6VpNNsTwDlSPoD91TwiOwxsA=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:23.019662 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-9de9139a-1401-49de-9641-66eb7a2a1050 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:17:23.023869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-9de9139a-1401-49de-9641-66eb7a2a1050 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:17:23.046565 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9de9139a-1401-49de-9641-66eb7a2a1050 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044882 May 20 09:17:23.047516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 317/603] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:17:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:23.235051 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:23.235806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:23.243202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:23.244374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:23.245174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:23.245779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:23.250784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:23.251460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:23.258437 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:23.260930 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:23.261956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:23.262201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:23.262631 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:23.407232 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:23.415184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8c2df974-c589-47b2-ab60-4582def1b50b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.169245 May 20 09:17:23.416299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 318/604] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:23 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:23.448657 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:23.450969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:23.458525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-897b906d-a953-4ffe-8731-895692e3e28e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.227472 May 20 09:17:23.468255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 287/605] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:23 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:23.966182 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:23.966893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:23.973501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:23.974072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:23.974837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:23.975238 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.108516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:24.116180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-478f8658-a361-4d2e-a8e8-dc0b7b4aceb9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.153976 May 20 09:17:24.116740 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 319/606] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:23 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:24.432816 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:24.434142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:24.441792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.442235 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.442996 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.443459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.473314 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1334244473", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "328df357-f834-447d-8616-ac57cd7979a2"}], "security_groups": [{"name": "tempest-securitygroup--1212572670"}], "key_name": "tempest-keypair-968254911", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:24.575000 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] validate_networks() for [('328df357-f834-447d-8616-ac57cd7979a2', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:17:24.577374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:24.585145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-68e970f7-775b-433e-b6e6-de8f2a890bfa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.156469 May 20 09:17:24.585718 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 288/607] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:24 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:24.590106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:24.590991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:24.597206 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.597643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.598406 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.598833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.729814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:24.737953 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-02051755-563a-46e1-b5e9-4af68f27d690 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.151254 May 20 09:17:24.738519 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 289/608] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:24 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:24.939317 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-75d4f3c4-3866-42c7-ac59-9ee6f9e61e36 req-d5d13a24-74f7-4678-9d92-6501052fc703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724e6ca0-78af-4670-a409-d2ee15ebf3d4", "name": "network-vif-plugged", "status": "completed", "tag": "9b807888-e022-4e95-89be-56a386f87d4b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:24.939758 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:17:24.940250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:17:24.940779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:17:24.941189 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:17:24.941599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:17:24.948582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-75d4f3c4-3866-42c7-ac59-9ee6f9e61e36 req-d5d13a24-74f7-4678-9d92-6501052fc703 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.949037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-75d4f3c4-3866-42c7-ac59-9ee6f9e61e36 req-d5d13a24-74f7-4678-9d92-6501052fc703 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.951075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.951731 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.952680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:24.953116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:24.962818 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-75d4f3c4-3866-42c7-ac59-9ee6f9e61e36 req-d5d13a24-74f7-4678-9d92-6501052fc703 service nova] Creating event network-vif-plugged:9b807888-e022-4e95-89be-56a386f87d4b for instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 on hv-cinder-83699 May 20 09:17:24.969064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-75d4f3c4-3866-42c7-ac59-9ee6f9e61e36 req-d5d13a24-74f7-4678-9d92-6501052fc703 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033922 May 20 09:17:24.969804 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 290/609] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:24.970326 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:17:24.974364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:17:24.985702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:17:24.988059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:17:25.036338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-84b61e0d-51b7-4deb-a573-4d6d277c2ec5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567247 May 20 09:17:25.036986 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 320/610] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:17:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 20 09:17:25.047483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-42688b25-55b3-4022-8ec7-592a0ae135e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:25.048172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-42688b25-55b3-4022-8ec7-592a0ae135e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:25.106882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-42688b25-55b3-4022-8ec7-592a0ae135e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:25.113779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-42688b25-55b3-4022-8ec7-592a0ae135e3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1241 microversion: 2.1 time: 0.070465 May 20 09:17:25.114522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 291/611] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:25 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:25.133529 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:25.134343 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:25.141817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:25.142317 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:25.143284 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:25.143719 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:25.286232 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:25.294588 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-45d25cec-add2-489b-9d61-27c714ca7a08 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1677 microversion: 2.1 time: 0.165009 May 20 09:17:25.303301 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 321/612] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:25 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:25.603879 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:25.605815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:25.613777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:25.614212 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:25.615057 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:25.615468 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:25.744650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:25.752683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e298b69b-a493-47b6-bbfb-28cac269b1f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1264 microversion: 2.1 time: 0.153955 May 20 09:17:25.753373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 292/613] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:25 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:25.755249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:25.756452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:25.763355 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:25.763808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:25.764567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:25.764995 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:25.899833 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:25.912942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-57cf8ca9-8409-4070-965d-fcd79b72d14f tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.161397 May 20 09:17:25.913974 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 322/614] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:25 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:26.135179 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:26.136867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:26.148763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.149168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.149961 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.150395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.217815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:26.225423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-58f97d8b-c907-43cc-a65c-8793e3325cf9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1293 microversion: 2.1 time: 0.097281 May 20 09:17:26.225999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 293/615] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:26 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:26.316404 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:26.317460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:26.327822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.328562 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.329802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.330516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.464890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:26.473618 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dcafafe8-2b85-4098-ada8-4be6e995fbbc tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1654 microversion: 2.1 time: 0.163878 May 20 09:17:26.474452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 323/616] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:26 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:26.490922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-78f03878-6f02-424c-873b-237acf0722ef tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:26.498934 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78f03878-6f02-424c-873b-237acf0722ef tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.500112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78f03878-6f02-424c-873b-237acf0722ef tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.528906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-78f03878-6f02-424c-873b-237acf0722ef tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Going to try to start instance {{(pid=117981) start /opt/stack/nova/nova/compute/api.py:2730}} May 20 09:17:26.574978 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-78f03878-6f02-424c-873b-237acf0722ef tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action" status: 202 len: 0 microversion: 2.1 time: 0.087792 May 20 09:17:26.575614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 294/617] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:17:26 2022] POST /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:17:26.583965 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:26.584578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:26.590836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.591308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.592063 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.592495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.726893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:26.735231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3b49f614-d88b-4d1f-b950-4ed6e926537a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1663 microversion: 2.1 time: 0.155204 May 20 09:17:26.735834 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 324/618] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:26 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:26.770600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:26.771284 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:26.773680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:26.779444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.779882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.780647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.781066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.930651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:26.932144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:26.940894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.941723 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.942742 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:26.943697 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:26.987640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:26.999756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ecb0c731-c484-486c-86d5-b669d74df610 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1451 microversion: 2.1 time: 0.233675 May 20 09:17:27.012177 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 295/619] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:26 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1451 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:27.017530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:27.018181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:27.025396 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:27.026340 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:27.026590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:27.027017 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:27.109542 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:27.119933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-401eed85-03dd-4dc6-bc8f-6bb50ecc8266 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.193324 May 20 09:17:27.120772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 325/620] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:26 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:27.242711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:27.243431 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:27.249972 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:27.250385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:27.251160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:27.251612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:27.315374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:27.323119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ef61f4a6-ed13-4a69-b04e-a8ba9921cf75 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1299 microversion: 2.1 time: 0.084204 May 20 09:17:27.323708 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 326/621] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:27 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:27.366897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:27.374613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b583f421-2deb-45ad-985b-80c1bd28bcf0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1451 microversion: 2.1 time: 0.361289 May 20 09:17:27.375180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 296/622] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:27 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1451 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:27.755778 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:27.756683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:27.764018 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:27.764507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:27.765260 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:27.765680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:28.143224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:28.147300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:28.164880 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:28.166249 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:28.168955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:28.169398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:28.203500 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:28.214621 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9d7e13d4-5066-49de-bc52-78595c477710 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1663 microversion: 2.1 time: 0.462691 May 20 09:17:28.215609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 327/623] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:27 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1663 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:28.340918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:28.341753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:28.353166 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:28.353970 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:28.354790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:28.355217 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:28.416867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:28.429584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-aeb6bf91-7388-4d69-ac87-e262c27350e3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.294692 May 20 09:17:28.442129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 297/624] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:28 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:28.587436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:28.595240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f8da3bf0-326e-4f2e-a4c6-c0e38edde96a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.259038 May 20 09:17:28.604703 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 328/625] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:28 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:28.992748 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-fe492312-42bd-49c3-88a5-f24078e82421 req-51894596-aa59-4d49-868e-147981991162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e1e109-bd6a-4764-b404-03e02b059042", "tag": "62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:29.006053 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-fe492312-42bd-49c3-88a5-f24078e82421 req-51894596-aa59-4d49-868e-147981991162 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.009401 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-fe492312-42bd-49c3-88a5-f24078e82421 req-51894596-aa59-4d49-868e-147981991162 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.022448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-fe492312-42bd-49c3-88a5-f24078e82421 req-51894596-aa59-4d49-868e-147981991162 service nova] Creating event network-changed:62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef for instance 03e1e109-bd6a-4764-b404-03e02b059042 on hv-cinder-83699 May 20 09:17:29.035346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-fe492312-42bd-49c3-88a5-f24078e82421 req-51894596-aa59-4d49-868e-147981991162 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046455 May 20 09:17:29.036817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 298/626] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:29.231668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:29.232282 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:29.239938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.240406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.241932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.243085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.451194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:29.451917 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:29.458407 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.458854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.459669 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.460097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.497990 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:29.500689 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:29.510508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2d1fde4b-b8b4-472b-80a7-9dd81cf4ea11 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1667 microversion: 2.1 time: 0.282628 May 20 09:17:29.511881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 329/627] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:29 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1667 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:29.600040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:29.608542 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cbc552e3-dfd7-4408-a9fd-18ed35cf37c2 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.162333 May 20 09:17:29.609116 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 299/628] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:29 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:29.614159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:29.615112 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:29.621731 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.622173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.622979 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:29.623440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:29.832498 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:29.840388 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8810131c-c038-45c5-91fd-9a6e3342c45f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.230316 May 20 09:17:29.840946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 330/629] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:29 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:30.166253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-189d1f8d-78cf-4883-938f-d4f57bb2de85 req-ab7c7ef4-168b-4932-8bb6-dcc778c9c684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724e6ca0-78af-4670-a409-d2ee15ebf3d4", "tag": "9b807888-e022-4e95-89be-56a386f87d4b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:30.174787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-189d1f8d-78cf-4883-938f-d4f57bb2de85 req-ab7c7ef4-168b-4932-8bb6-dcc778c9c684 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:30.175225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-189d1f8d-78cf-4883-938f-d4f57bb2de85 req-ab7c7ef4-168b-4932-8bb6-dcc778c9c684 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:30.186785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-189d1f8d-78cf-4883-938f-d4f57bb2de85 req-ab7c7ef4-168b-4932-8bb6-dcc778c9c684 service nova] Creating event network-changed:9b807888-e022-4e95-89be-56a386f87d4b for instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 on hv-cinder-83699 May 20 09:17:30.191909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-189d1f8d-78cf-4883-938f-d4f57bb2de85 req-ab7c7ef4-168b-4932-8bb6-dcc778c9c684 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029401 May 20 09:17:30.192542 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 300/630] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:30.626128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:30.626709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:30.633007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:30.633715 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:30.634487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:30.634918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:30.780288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:30.790396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9f429ca7-b7f6-4fa9-90f9-84ed6aba5832 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.168194 May 20 09:17:30.791358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 331/631] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:30 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:30.857920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:30.858596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:30.867421 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:30.867869 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:30.868650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:30.869082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:31.020555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:31.028508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ac1debdc-4148-40ef-863d-cb03a0338ad3 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.174923 May 20 09:17:31.029246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 301/632] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:30 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:31.809411 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:31.810031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:31.817072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:31.817538 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:31.818305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:31.818737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:31.953541 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:31.961880 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-295c7db2-c507-4cbe-9b33-7676df2fbe48 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.156394 May 20 09:17:31.962428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 332/633] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:31 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:32.045684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:32.046228 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:32.053814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:32.054230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:32.055202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:32.055712 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:32.508436 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:32.516652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-de1eb2dc-9663-4bdf-9b18-fd9e44dd33a0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.475019 May 20 09:17:32.517213 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 302/634] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:32 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:32.981836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:32.982849 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:32.989554 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:32.989999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:32.990761 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:32.991193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:33.173896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:33.181911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dd9db110-df7a-47d8-bff0-42879836cf3b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1734 microversion: 2.1 time: 0.205325 May 20 09:17:33.182492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 333/635] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:32 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:33.538928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:33.539650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:33.547297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:33.547796 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:33.548645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:33.549125 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:33.683240 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:33.691416 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eb19ea59-b429-457c-b8fd-d80ce3757c50 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.159188 May 20 09:17:33.691995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 303/636] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:33 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:34.199198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:34.199979 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:34.207029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.207512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.208271 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.208702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.347581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:34.356017 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-21f5762c-b743-4508-a197-2f0bd39017cb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1714 microversion: 2.1 time: 0.160714 May 20 09:17:34.356588 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 334/637] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:34 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:34.470901 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:34.471517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:34.479560 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.480026 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.480781 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.481205 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.606601 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] HTTP exception thrown: Cannot 'detach_volume' instance d6bf483f-196d-4699-8ca8-968382aecdac while it is in vm_state rescued May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Request method failure captured: May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments/d663907c-27e8-482c-bc3a-f217e1b82622 HTTP/1.1 May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1u0gzpwdtG3vy6mWamlIc0JNfTDCKnkS4SIiO2QpGgBLv6VLtVhm2Cx_-q7ygegAF8h1To5N5kpqxz6Obju8-I-oeEi0a91uAEw1KPehzRdb2mo9x3dF4fWRK15gOa7xynHPgCsfX5DVcj5xwy3flzTJPmMWW_d_9JU7Rlcyay0sTE May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:17:34.608232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed0e52a9d6374123b57759435d43d7aa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}] May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 992571802b7d426f923e0f0bc41e28de May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:17:34.609838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Cannot 'detach_volume' instance d6bf483f-196d-4699-8ca8-968382aecdac while it is in vm_state rescued May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'server_id': 'd6bf483f-196d-4699-8ca8-968382aecdac', 'id': 'd663907c-27e8-482c-bc3a-f217e1b82622'} May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6bf483f-196d-4699-8ca8-968382aecdac in vm_state rescued. Cannot detach_volume while the instance is in this state. May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:17:34.610652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d6bf483f-196d-4699-8ca8-968382aecdac while it is in vm_state rescued May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d6bf483f-196d-4699-8ca8-968382aecdac while it is in vm_state rescued May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:17:34.612321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Returning 409 to user: Cannot 'detach_volume' instance d6bf483f-196d-4699-8ca8-968382aecdac while it is in vm_state rescued {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:17:34.613595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0fcac377-be8d-4b19-8054-85ef88c83fba tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments/d663907c-27e8-482c-bc3a-f217e1b82622" status: 409 len: 152 microversion: 2.1 time: 0.143044 May 20 09:17:34.613595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 304/638] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:17:34 2022] DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments/d663907c-27e8-482c-bc3a-f217e1b82622 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 20 09:17:34.618948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:34.619518 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:34.626016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.626470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.627230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.627774 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.701948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ae170435-9e53-48f8-beda-954f8460c56e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "POST /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/action" status: 202 len: 0 microversion: 2.1 time: 0.086485 May 20 09:17:34.704216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 335/639] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:17:34 2022] POST /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:17:34.708722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:34.709358 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:34.710979 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:34.711753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:34.716361 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.716803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.717586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.718009 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.718142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.718452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.719207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.719671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:34.860107 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:34.868058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:34.872916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c402bfb1-8a23-4752-9c40-0bc9a2f4331d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.168143 May 20 09:17:34.873534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 305/640] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:34 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:34.878130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ef0012f1-d8e2-4ecb-a146-371985da77f3 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1722 microversion: 2.1 time: 0.171231 May 20 09:17:34.879867 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 336/641] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:34 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:34.975662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-c36f69e1-7abc-45f9-b8b0-4c640e6d9a2c req-9dc9b473-891f-4220-a2fa-7087c7e269fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e1e109-bd6a-4764-b404-03e02b059042", "name": "network-vif-plugged", "status": "completed", "tag": "62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:34.987656 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c36f69e1-7abc-45f9-b8b0-4c640e6d9a2c req-9dc9b473-891f-4220-a2fa-7087c7e269fa service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:34.988056 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c36f69e1-7abc-45f9-b8b0-4c640e6d9a2c req-9dc9b473-891f-4220-a2fa-7087c7e269fa service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:35.003489 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-c36f69e1-7abc-45f9-b8b0-4c640e6d9a2c req-9dc9b473-891f-4220-a2fa-7087c7e269fa service nova] Creating event network-vif-plugged:62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef for instance 03e1e109-bd6a-4764-b404-03e02b059042 on hv-cinder-83699 May 20 09:17:35.008739 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-c36f69e1-7abc-45f9-b8b0-4c640e6d9a2c req-9dc9b473-891f-4220-a2fa-7087c7e269fa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036957 May 20 09:17:35.009999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 306/642] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:35.894334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:35.895659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:35.900418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:35.901724 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=10 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:35.902239 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:35.903315 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:35.906736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:35.908866 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:35.909643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:35.910956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:35.911678 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:35.915520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:35.916039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:35.916696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:35.917116 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:35.921493 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:17:36.048312 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:36.048561 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:36.056194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fb7d5a78-92b0-4095-a960-766775f1d415 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.168574 May 20 09:17:36.056454 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ad399477-a273-4b77-a856-56d5bdf90c91 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1722 microversion: 2.1 time: 0.161919 May 20 09:17:36.056769 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 337/643] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:35 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:36.057046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 307/644] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:35 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:37.077478 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:37.078447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:37.078447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:37.079143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:37.088917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:37.089090 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:37.089368 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:37.089538 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:37.090162 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:37.090308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:37.090591 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:37.090750 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:37.222360 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:37.224994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:37.230660 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5597400b-31f9-4734-88a4-d42f651b45f4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1367 microversion: 2.1 time: 0.159860 May 20 09:17:37.231288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 338/645] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:37 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:37.233238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-00ddb574-4076-430c-95cc-5f3166a56df8 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1722 microversion: 2.1 time: 0.162274 May 20 09:17:37.233807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 308/646] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:37 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:17:38.252076 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:38.253277 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:38.253790 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:38.254791 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:38.263017 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:38.263495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:38.263818 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:38.264257 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:38.264399 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:38.264686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:38.265013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:38.265447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:38.405787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:38.406941 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:38.414087 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-28d35bc3-4fea-4f3b-b647-2494275d6fdd tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1722 microversion: 2.1 time: 0.166833 May 20 09:17:38.414488 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d9dbdf73-d6d8-4a97-89db-f95af97e8ed1 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1557 microversion: 2.1 time: 0.168985 May 20 09:17:38.414798 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 309/647] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:38 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:38.415048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 339/648] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:38 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:38.430397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:38.430884 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:38.437209 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:38.437759 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:38.438540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:38.439334 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:38.516341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f97196e9-3439-4920-a0ad-8dcb7c387f88 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089529 May 20 09:17:38.517251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 310/649] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:17:38 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:39.430517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:39.431098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:39.438162 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:39.438511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:39.439330 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:39.439778 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:39.461637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-c8d21803-658b-4c03-8aa1-d7a6d08450ee req-90a7f0c2-56c4-4cc7-b5df-53b3a4ab48bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e1e109-bd6a-4764-b404-03e02b059042", "tag": "62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:39.470296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c8d21803-658b-4c03-8aa1-d7a6d08450ee req-90a7f0c2-56c4-4cc7-b5df-53b3a4ab48bf service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:39.470744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c8d21803-658b-4c03-8aa1-d7a6d08450ee req-90a7f0c2-56c4-4cc7-b5df-53b3a4ab48bf service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:39.482787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-c8d21803-658b-4c03-8aa1-d7a6d08450ee req-90a7f0c2-56c4-4cc7-b5df-53b3a4ab48bf service nova] Creating event network-changed:62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef for instance 03e1e109-bd6a-4764-b404-03e02b059042 on hv-cinder-83699 May 20 09:17:39.488253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-c8d21803-658b-4c03-8aa1-d7a6d08450ee req-90a7f0c2-56c4-4cc7-b5df-53b3a4ab48bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030764 May 20 09:17:39.488860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 311/650] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:17:39.612511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:17:39.621581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a9627ecc-7413-466d-8fe6-3c6607bc2979 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1728 microversion: 2.1 time: 0.194924 May 20 09:17:39.622328 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 340/651] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:17:39 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:17:39.638974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:17:39.639551 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:17:39.646595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:39.647033 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:39.647792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:39.648378 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:39.727500 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d92ae7a3-be0e-4d8c-9c6e-0ab1b168b685 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092726 May 20 09:17:39.728201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 312/652] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:17:39 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:17:41.502852 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-48cf0c91-26f2-4a50-8f70-df64af13c1b3 req-559325b6-f077-4e25-9223-f8a97eee5758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bf483f-196d-4699-8ca8-968382aecdac", "tag": "7c2e256c-0d81-4712-b95d-356933f6fd80"}, {"name": "network-changed", "server_uuid": "d6bf483f-196d-4699-8ca8-968382aecdac", "tag": "7c2e256c-0d81-4712-b95d-356933f6fd80"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:17:41.511908 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-48cf0c91-26f2-4a50-8f70-df64af13c1b3 req-559325b6-f077-4e25-9223-f8a97eee5758 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:17:41.512340 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-48cf0c91-26f2-4a50-8f70-df64af13c1b3 req-559325b6-f077-4e25-9223-f8a97eee5758 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:17:41.523751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-48cf0c91-26f2-4a50-8f70-df64af13c1b3 req-559325b6-f077-4e25-9223-f8a97eee5758 service nova] Creating event network-changed:7c2e256c-0d81-4712-b95d-356933f6fd80 for instance d6bf483f-196d-4699-8ca8-968382aecdac on hv-cinder-83699 May 20 09:17:41.524255 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-48cf0c91-26f2-4a50-8f70-df64af13c1b3 req-559325b6-f077-4e25-9223-f8a97eee5758 service nova] Creating event network-changed:7c2e256c-0d81-4712-b95d-356933f6fd80 for instance d6bf483f-196d-4699-8ca8-968382aecdac on hv-cinder-83699 May 20 09:17:41.529761 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-48cf0c91-26f2-4a50-8f70-df64af13c1b3 req-559325b6-f077-4e25-9223-f8a97eee5758 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030574 May 20 09:17:41.530385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 341/653] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:01.399846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=35 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:01.400774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=27 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:01.405451 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:01.405987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:01.412862 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:01.413297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:01.414076 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:01.414496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:01.443572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-62084aed-dea7-490d-92a2-292857bb1fe6 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments/ed93e262-c68b-46ba-8eed-840da1255408" status: 200 len: 194 microversion: 2.20 time: 0.045584 May 20 09:18:01.444142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 313/654] 10.222.0.69 () {60 vars in 1453 bytes} [Fri May 20 09:18:01 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments/ed93e262-c68b-46ba-8eed-840da1255408 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:18:01.515310 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:01.516073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:01.520883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:01.521459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:01.529044 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:01.529530 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:01.530246 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:01.530696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:01.632353 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lazy-loading 'services' on Instance uuid b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:01.712881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-019211f3-43f6-473f-a3ac-69000758678b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments/ed93e262-c68b-46ba-8eed-840da1255408" status: 202 len: 0 microversion: 2.20 time: 0.199094 May 20 09:18:01.713477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 342/655] 10.222.0.69 () {60 vars in 1456 bytes} [Fri May 20 09:18:01 2022] DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments/ed93e262-c68b-46ba-8eed-840da1255408 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 20 09:18:01.722112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:01.723033 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:01.729201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:01.729642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:01.730391 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:01.730819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:01.761474 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1ac8c7e6-8a4b-4674-a0ce-7029352f2393 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 May 20 09:18:01.762047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 314/656] 10.222.0.69 () {60 vars in 1342 bytes} [Fri May 20 09:18:01 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:18:02.775821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:02.776994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:02.783948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:02.784377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:02.785180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:02.785608 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:02.815313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3cd858a2-6994-4570-a59e-e0fdac9c989d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044734 May 20 09:18:02.815870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 343/657] 10.222.0.69 () {60 vars in 1342 bytes} [Fri May 20 09:18:02 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:02.880102 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:02.880707 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:02.887389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:02.887838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:02.888587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:02.889017 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:02.914159 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:18:02.996074 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c5d0706d-4521-4a3e-ad3c-4170733634ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 204 len: 0 microversion: 2.20 time: 0.120405 May 20 09:18:02.997064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 315/658] 10.222.0.69 () {60 vars in 1279 bytes} [Fri May 20 09:18:02 2022] DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 20 09:18:03.006566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:03.007349 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:03.016545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:03.016988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:03.018862 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:03.019649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:03.167154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:03.175250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:03.176801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:03.178127 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6c88f1d7-71bb-46f9-af22-9eb8fd472722 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.175797 May 20 09:18:03.178702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 344/659] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:03 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:04.203320 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:04.204288 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:04.211492 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:04.211937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:04.212696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:04.213119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:04.347614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:04.359956 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:04.362079 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:04.363237 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7cdd2044-f496-4d26-964e-c5015ccb3d09 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.168488 May 20 09:18:04.363821 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 316/660] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:04 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:05.382107 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:05.382726 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:05.389746 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:05.390218 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:05.390956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:05.391423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:05.579659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:05.587781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:05.589286 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:05.590439 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9f1cd8c8-eaad-469d-aa74-b4d49ef12e73 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 200 len: 1722 microversion: 2.20 time: 0.212602 May 20 09:18:05.591036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 345/661] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:05 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:05.871897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-db780893-fd5e-42ca-afaf-4da0ea82a8d7 req-9e211704-8c9d-4c44-a1db-44b1c4ff881b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d7463c-5e56-405b-911d-9b7fa6d3f7d9", "name": "network-vif-deleted", "tag": "d8e5bd7c-3deb-4042-9ef4-77d147264d87"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:05.881413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-db780893-fd5e-42ca-afaf-4da0ea82a8d7 req-9e211704-8c9d-4c44-a1db-44b1c4ff881b service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:05.881968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-db780893-fd5e-42ca-afaf-4da0ea82a8d7 req-9e211704-8c9d-4c44-a1db-44b1c4ff881b service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:05.894741 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-db780893-fd5e-42ca-afaf-4da0ea82a8d7 req-9e211704-8c9d-4c44-a1db-44b1c4ff881b service nova] Creating event network-vif-deleted:d8e5bd7c-3deb-4042-9ef4-77d147264d87 for instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 on hv-cinder-83699 May 20 09:18:05.899919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-db780893-fd5e-42ca-afaf-4da0ea82a8d7 req-9e211704-8c9d-4c44-a1db-44b1c4ff881b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032868 May 20 09:18:05.900710 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 317/662] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:06.609462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:06.610133 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:06.618039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:06.618491 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:06.619663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:06.620371 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:06.636700 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] HTTP exception thrown: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Request method failure captured: May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 HTTP/1.1 May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBVQMz1shIyBDx8NSCwVhGyOZPuo9OwulvZ_SFHD4v7Wz2hkX6nF-wv9_TZWP8N7uShME3tfR5lrz7f4S0idXwihsSGogMSR8Gp0aHNg0dTE9sgQXftqoIsG1r4g84vYc9WKIeV4HsADsLvTbnYf94g8LGS3LNuPHOHjErNY62eBQ May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Openstack-Nova-Api-Version: 2.20 May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:18:06.638400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92bf8a2fea6243c28aff53d39a57f92c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}] May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a7e574dc676841dea1f23a06c333ff14 May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:18:06.640147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'b7d7463c-5e56-405b-911d-9b7fa6d3f7d9'} May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:06.640988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:18:06.642195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:06.643309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Returning 404 to user: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:06.643309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cb573ba4-8592-46ab-9866-2f643cbd089f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 404 len: 111 microversion: 2.20 time: 0.034334 May 20 09:18:06.643309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 346/663] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:06 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 20 09:18:06.649931 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-df4317fd-e3f8-43cc-a729-c88c5c081edf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '.version_select at 0x7f7c87638550>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:06.670225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-df4317fd-e3f8-43cc-a729-c88c5c081edf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994885927" status: 204 len: 0 microversion: 2.20 time: 0.024518 May 20 09:18:06.670916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 318/664] 10.222.0.69 () {60 vars in 1258 bytes} [Fri May 20 09:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994885927 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 20 09:18:07.547230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-49827e09-b04a-4af8-8b83-48c15779f507 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'create', calling method: .version_select at 0x7f7c86e364c0>, body: {"keypair": {"name": "tempest-keypair-472723151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVMCmmAtZUE19fBODncqwsO/ib5kbC9TZ53brAFPOWIqRkbp9PIj0Wq5ysd8kMqCXdT6zwq/wOzzy5laogDgHAS542KjljZRFuFvBBJO/HR/8kU5ghjPLAlR5Is3d0tAQ=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:07.566165 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-49827e09-b04a-4af8-8b83-48c15779f507 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:18:07.570281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-49827e09-b04a-4af8-8b83-48c15779f507 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for user a7e574dc676841dea1f23a06c333ff14 and project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:18:07.597409 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-49827e09-b04a-4af8-8b83-48c15779f507 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054059 May 20 09:18:07.598026 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 347/665] 10.222.0.69 () {62 vars in 1199 bytes} [Fri May 20 09:18:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 20 09:18:08.906534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-466067215", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb464892-cf71-4d2e-b68f-60163c12a0fe"}], "security_groups": [{"name": "tempest-securitygroup--532894247"}], "key_name": "tempest-keypair-472723151", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:09.010434 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] validate_networks() for [('cb464892-cf71-4d2e-b68f-60163c12a0fe', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:18:09.385860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:18:09.386283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:18:09.386749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:18:09.387180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:18:09.387610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:18:09.397442 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:09.397882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:09.398667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:09.399096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:09.418446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:18:09.422424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Getting quotas for user a7e574dc676841dea1f23a06c333ff14 and project 92bf8a2fea6243c28aff53d39a57f92c. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:18:09.434880 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:18:09.437236 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:18:09.487859 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1adfad33-b639-494b-9b97-4f8555cff2af tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.585725 May 20 09:18:09.488573 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 319/666] 10.222.0.69 () {62 vars in 1187 bytes} [Fri May 20 09:18:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 20 09:18:09.499449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-78e24ae1-74ec-4771-b326-52ad371a06c8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:09.499983 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-78e24ae1-74ec-4771-b326-52ad371a06c8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:09.561420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78e24ae1-74ec-4771-b326-52ad371a06c8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:09.570130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78e24ae1-74ec-4771-b326-52ad371a06c8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:09.571660 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78e24ae1-74ec-4771-b326-52ad371a06c8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:09.572813 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-78e24ae1-74ec-4771-b326-52ad371a06c8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1280 microversion: 2.20 time: 0.077945 May 20 09:18:09.573364 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 348/667] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:09 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:10.592068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:10.592692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:10.599513 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:10.599962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:10.600731 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:10.601168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:10.667885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:10.676489 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:10.678015 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:10.679128 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5a9b00be-d559-4e57-9c90-b22208f6a928 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1350 microversion: 2.20 time: 0.092587 May 20 09:18:10.679939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 320/668] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:10 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:11.697773 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:11.698357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:11.705613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:11.706063 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:11.706837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:11.707287 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:11.922935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:11.931609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:11.933505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:11.934828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3625316f-0e9a-4d5a-b5a4-6ae318e53523 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1405 microversion: 2.20 time: 0.241234 May 20 09:18:11.935637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 349/669] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:11 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:12.104962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-bdc09453-ecf2-4575-90b4-a03c89c0ee07 req-2c5b123b-e500-4029-8a8c-b6fd9dd748c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:12.118886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-bdc09453-ecf2-4575-90b4-a03c89c0ee07 req-2c5b123b-e500-4029-8a8c-b6fd9dd748c6 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:12.119395 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-bdc09453-ecf2-4575-90b4-a03c89c0ee07 req-2c5b123b-e500-4029-8a8c-b6fd9dd748c6 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:12.140675 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-bdc09453-ecf2-4575-90b4-a03c89c0ee07 req-2c5b123b-e500-4029-8a8c-b6fd9dd748c6 service nova] Creating event network-changed:0fff114c-fe55-4714-bbdc-e879108b685e for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 on hv-cinder-83699 May 20 09:18:12.146482 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-bdc09453-ecf2-4575-90b4-a03c89c0ee07 req-2c5b123b-e500-4029-8a8c-b6fd9dd748c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045851 May 20 09:18:12.147318 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 321/670] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:12.957814 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:12.958492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:12.965715 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:12.966160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:12.966926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:12.967424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:13.099764 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:13.107840 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:13.109293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:13.110397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-886f11b3-c654-4f68-9c5f-e57ce82e0826 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1405 microversion: 2.20 time: 0.159176 May 20 09:18:13.110963 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 350/671] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:12 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:14.129892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:14.130576 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:14.137391 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:14.137834 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:14.138580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:14.139006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:14.272364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:14.280688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:14.282194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:14.283340 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-71ee0d3a-1987-43c0-9929-df90ea00a768 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1405 microversion: 2.20 time: 0.158391 May 20 09:18:14.283905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 322/672] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:14 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:15.304501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:15.305043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:15.314926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:15.315402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:15.316152 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:15.316575 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:15.447858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:15.456209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:15.457736 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:15.458851 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-438df09d-1983-4776-9d26-81fc97fbd5cd tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1405 microversion: 2.20 time: 0.160796 May 20 09:18:15.459443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 351/673] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:15 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:16.481574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:16.482645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:16.493191 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:16.493935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:16.495193 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:16.495957 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:16.639910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:16.652890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:16.654929 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:16.656350 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fba1d484-5f7a-4cef-8381-d82ff93e68bb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1405 microversion: 2.20 time: 0.181499 May 20 09:18:16.657058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 323/674] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:16 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:17.147083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-532cba18-b56b-499b-befe-685af84df01f req-9efd76c2-db3e-40b4-9fe1-ab3d14d27e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "name": "network-vif-plugged", "status": "completed", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:17.156448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-532cba18-b56b-499b-befe-685af84df01f req-9efd76c2-db3e-40b4-9fe1-ab3d14d27e4f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:17.156817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-532cba18-b56b-499b-befe-685af84df01f req-9efd76c2-db3e-40b4-9fe1-ab3d14d27e4f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:17.168370 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-532cba18-b56b-499b-befe-685af84df01f req-9efd76c2-db3e-40b4-9fe1-ab3d14d27e4f service nova] Creating event network-vif-plugged:0fff114c-fe55-4714-bbdc-e879108b685e for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 on hv-cinder-83699 May 20 09:18:17.173337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-532cba18-b56b-499b-befe-685af84df01f req-9efd76c2-db3e-40b4-9fe1-ab3d14d27e4f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030380 May 20 09:18:17.173926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 352/675] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:17.676640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:17.677184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:17.684150 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:17.684596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:17.685350 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:17.685784 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:17.939778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:17.948114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:17.949606 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:17.950713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4e7acc4c-5e68-4761-bede-2eac84e6d62b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1405 microversion: 2.20 time: 0.278368 May 20 09:18:17.951244 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 324/676] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:17 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:18.970116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:18.970807 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:18.977670 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:18.978119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:18.978973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:18.979450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:19.113264 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:19.121467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:19.123136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:19.124453 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f618acdc-8e46-4a86-970e-b9d3211616ff tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1597 microversion: 2.20 time: 0.159122 May 20 09:18:19.125151 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 353/677] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:18 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:18:19.145115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:19.145739 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:19.152527 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:19.152974 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:19.153749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:19.154171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:19.242433 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6edbb5a8-5c34-4ecd-b5f5-54746645b142 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101398 May 20 09:18:19.243280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 325/678] 10.222.0.69 () {60 vars in 1315 bytes} [Fri May 20 09:18:19 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:18:20.185090 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-58330112-07cd-4c3f-8838-72d1d48ab3a7 req-5828fa0b-a67e-4311-aca2-331a1cf20abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:20.189032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:20.196477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-58330112-07cd-4c3f-8838-72d1d48ab3a7 req-5828fa0b-a67e-4311-aca2-331a1cf20abb service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:20.196915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-58330112-07cd-4c3f-8838-72d1d48ab3a7 req-5828fa0b-a67e-4311-aca2-331a1cf20abb service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:20.210817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-58330112-07cd-4c3f-8838-72d1d48ab3a7 req-5828fa0b-a67e-4311-aca2-331a1cf20abb service nova] Creating event network-changed:0fff114c-fe55-4714-bbdc-e879108b685e for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 on hv-cinder-83699 May 20 09:18:20.216068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-58330112-07cd-4c3f-8838-72d1d48ab3a7 req-5828fa0b-a67e-4311-aca2-331a1cf20abb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034535 May 20 09:18:20.216860 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 354/679] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:20.390836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:20.392664 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:20.397890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:20.398735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:20.405129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:20.405849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:20.406677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:20.407356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:20.433957 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7fce6778-d0a6-4e4e-9cad-e22da097a525 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/ips" status: 200 len: 149 microversion: 2.1 time: 0.043782 May 20 09:18:20.434600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 326/680] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:18:20 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:21.568788 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:21.569375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:21.576564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:21.577012 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:21.577775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:21.578211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:21.765426 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lazy-loading 'services' on Instance uuid d6bf483f-196d-4699-8ca8-968382aecdac {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:21.798715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dcb29db-0b28-4703-a98b-2f93b13d50cf"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:21.799819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:21.806374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:21.806819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:21.807607 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:21.808039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:21.839294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-959775b8-71c8-46ba-b970-55c76a489ea1 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments/d663907c-27e8-482c-bc3a-f217e1b82622" status: 202 len: 0 microversion: 2.1 time: 0.274543 May 20 09:18:21.839958 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 355/681] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:18:21 2022] DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments/d663907c-27e8-482c-bc3a-f217e1b82622 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:18:21.849544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:21.850781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:21.857356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:21.857711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:21.858518 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:21.859047 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:21.894920 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fc0ad58f-671c-4520-a565-7ef807475d21 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050349 May 20 09:18:21.895718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 356/682] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:18:21 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:22.053676 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-26d689fa-33a1-412e-a98d-90f04a1dbcf0 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258874 May 20 09:18:22.054323 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 327/683] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:18:21 2022] POST /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:22.906556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:22.907523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:22.914574 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:22.915015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:22.915808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:22.916242 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:22.946200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-34f8424b-9840-4a80-840f-df9f87aed166 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043605 May 20 09:18:22.946789 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 357/684] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:18:22 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:18:23.020821 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:23.021624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:23.028674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:23.029281 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:23.030220 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:23.030918 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:23.057000 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:18:23.105420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:23.140602 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-be8d8d29-7856-4d6d-b995-ed88d141601d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 204 len: 0 microversion: 2.1 time: 0.125700 May 20 09:18:23.144441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 328/685] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:18:23 2022] DELETE /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:18:23.149725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:23.150328 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:23.156846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:23.157503 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:23.158370 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:23.158891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:23.293922 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:23.305495 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-727e978f-8db9-4a4d-be0c-e35a0b44667e tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1688 microversion: 2.1 time: 0.159355 May 20 09:18:23.306175 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 358/686] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:23 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:24.328042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:24.329117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:24.337594 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:24.338037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:24.338792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:24.339218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:24.476503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:24.484246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0e8886c7-29e1-4c14-b517-cc34291d7cd9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1688 microversion: 2.1 time: 0.163518 May 20 09:18:24.484817 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 329/687] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:24 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:25.564459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:25.565069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:25.571472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:25.571915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:25.572696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:25.573125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:25.714629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:25.728362 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0c67a085-55a7-4762-afb7-612a6bff7c8c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1688 microversion: 2.1 time: 0.229200 May 20 09:18:25.729309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 359/688] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:25 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:26.750321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:26.751617 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:26.758692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:26.759143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:26.759928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:26.760362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:26.891163 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:26.902847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-071f39cc-3477-4dc0-b622-d7ba1059f0cf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1688 microversion: 2.1 time: 0.156245 May 20 09:18:26.903674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 330/689] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:26 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:27.922195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:27.922872 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:27.929654 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:27.930098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:27.930874 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:27.931322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:27.998157 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:28.007577 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a29836f2-7da7-4c05-b468-1e070eca0217 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1621 microversion: 2.1 time: 0.089200 May 20 09:18:28.008379 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 360/690] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:27 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:28.060909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-791a3c4d-2eec-4884-a5c3-da7b37c7b17c req-23b0790c-8c69-4a01-b195-12c06e17ef30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bf483f-196d-4699-8ca8-968382aecdac", "name": "network-vif-deleted", "tag": "7c2e256c-0d81-4712-b95d-356933f6fd80"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:28.072187 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-791a3c4d-2eec-4884-a5c3-da7b37c7b17c req-23b0790c-8c69-4a01-b195-12c06e17ef30 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:28.072639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-791a3c4d-2eec-4884-a5c3-da7b37c7b17c req-23b0790c-8c69-4a01-b195-12c06e17ef30 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:28.091382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-791a3c4d-2eec-4884-a5c3-da7b37c7b17c req-23b0790c-8c69-4a01-b195-12c06e17ef30 service nova] Creating event network-vif-deleted:7c2e256c-0d81-4712-b95d-356933f6fd80 for instance d6bf483f-196d-4699-8ca8-968382aecdac on hv-cinder-83699 May 20 09:18:28.096436 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-791a3c4d-2eec-4884-a5c3-da7b37c7b17c req-23b0790c-8c69-4a01-b195-12c06e17ef30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 May 20 09:18:28.097244 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 331/691] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:29.025308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:29.025890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:29.032782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.033224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.033967 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.034394 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.039534 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:29.071193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.071671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.072115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lazy-loading 'fault' on Instance uuid d6bf483f-196d-4699-8ca8-968382aecdac {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:29.131025 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:29.138845 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0ef65414-47de-4e4a-84a1-d949659cfa4c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 200 len: 1335 microversion: 2.1 time: 0.117379 May 20 09:18:29.139447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 361/692] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:29 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:29.585477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dcb29db-0b28-4703-a98b-2f93b13d50cf"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:29.586607 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:29.593211 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.593649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.594389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.594808 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.684637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Invalid volume: volume 7dcb29db-0b28-4703-a98b-2f93b13d50cf is already attached to instances: 03e1e109-bd6a-4764-b404-03e02b059042 May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments HTTP/1.1 May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 74 May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:18:29.686356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {"volumeAttachment": {"volumeId": "7dcb29db-0b28-4703-a98b-2f93b13d50cf"}} May 20 09:18:29.687935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Invalid volume: volume 7dcb29db-0b28-4703-a98b-2f93b13d50cf is already attached to instances: 03e1e109-bd6a-4764-b404-03e02b059042 May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'server_id': '03e1e109-bd6a-4764-b404-03e02b059042', 'body': {'volumeAttachment': {'volumeId': '7dcb29db-0b28-4703-a98b-2f93b13d50cf'}}} May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7dcb29db-0b28-4703-a98b-2f93b13d50cf is already attached to instances: 03e1e109-bd6a-4764-b404-03e02b059042 May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:29.688865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7dcb29db-0b28-4703-a98b-2f93b13d50cf is already attached to instances: 03e1e109-bd6a-4764-b404-03e02b059042 May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:29.690250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7dcb29db-0b28-4703-a98b-2f93b13d50cf is already attached to instances: 03e1e109-bd6a-4764-b404-03e02b059042 May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 400 to user: Invalid volume: volume 7dcb29db-0b28-4703-a98b-2f93b13d50cf is already attached to instances: 03e1e109-bd6a-4764-b404-03e02b059042 {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f5cd9fde-0d4f-41ba-87ea-6d5d03e5e8bc tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107352 May 20 09:18:29.691665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 332/693] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:18:29 2022] POST /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 20 09:18:29.752613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:29.753097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:29.759826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.760303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.761050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.761479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.844096 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lazy-loading 'services' on Instance uuid 03e1e109-bd6a-4764-b404-03e02b059042 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:29.919373 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8603025c-66e1-4134-a03b-29cc50d0d00b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments/7dcb29db-0b28-4703-a98b-2f93b13d50cf" status: 202 len: 0 microversion: 2.1 time: 0.170550 May 20 09:18:29.920005 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 362/694] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:18:29 2022] DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments/7dcb29db-0b28-4703-a98b-2f93b13d50cf => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:18:29.928590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:29.929528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:29.936522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.936970 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.937794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:29.938230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:29.968439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-35ef2f41-7b2b-4703-836f-c90c66a4ab49 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 May 20 09:18:29.968938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 333/695] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:18:29 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:30.161869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:30.163003 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: d6bf483f-196d-4699-8ca8-968382aecdac] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:30.173580 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:30.174323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:30.175631 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:30.176354 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:30.190244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] HTTP exception thrown: Instance d6bf483f-196d-4699-8ca8-968382aecdac could not be found. May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Request method failure captured: May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac HTTP/1.1 May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1u0gzpwdtG3vy6mWamlIc0JNfTDCKnkS4SIiO2QpGgBLv6VLtVhm2Cx_-q7ygegAF8h1To5N5kpqxz6Obju8-I-oeEi0a91uAEw1KPehzRdb2mo9x3dF4fWRK15gOa7xynHPgCsfX5DVcj5xwy3flzTJPmMWW_d_9JU7Rlcyay0sTE May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:18:30.191896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed0e52a9d6374123b57759435d43d7aa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}] May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: 992571802b7d426f923e0f0bc41e28de May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance d6bf483f-196d-4699-8ca8-968382aecdac could not be found. May 20 09:18:30.193387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'd6bf483f-196d-4699-8ca8-968382aecdac'} May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bf483f-196d-4699-8ca8-968382aecdac could not be found. May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:30.194252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bf483f-196d-4699-8ca8-968382aecdac could not be found. May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bf483f-196d-4699-8ca8-968382aecdac could not be found. May 20 09:18:30.195650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:30.197028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Returning 404 to user: Instance d6bf483f-196d-4699-8ca8-968382aecdac could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:30.197028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8767ac7d-a578-44dc-8804-fa0f517fca8a tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac" status: 404 len: 111 microversion: 2.1 time: 0.039278 May 20 09:18:30.197028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 363/696] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:30 2022] GET /compute/v2.1/servers/d6bf483f-196d-4699-8ca8-968382aecdac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:18:30.202251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-604883d5-0a5b-4435-9096-5e790e5c88bb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '.version_select at 0x7f7c8c051e50>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:30.223378 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-604883d5-0a5b-4435-9096-5e790e5c88bb tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129922101" status: 202 len: 0 microversion: 2.1 time: 0.024925 May 20 09:18:30.223863 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 334/697] 10.222.0.69 () {58 vars in 1220 bytes} [Fri May 20 09:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129922101 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:18:30.980232 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:30.981293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:30.987513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:30.987955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:30.988703 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:30.989134 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:31.018625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3cdfa1c2-f462-4066-a768-e136adace617 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042294 May 20 09:18:31.019561 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 364/698] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:18:30 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:18:31.088228 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:31.088708 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:31.095214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:31.095842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:31.096649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:31.097041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:31.125819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:18:31.203663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9d90ce35-d4de-4914-a41d-704b825c10b7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 204 len: 0 microversion: 2.1 time: 0.119927 May 20 09:18:31.204273 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 335/699] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:18:31 2022] DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:18:31.212992 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:31.213601 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:31.220345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:31.220786 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:31.221536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:31.221963 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:31.350204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:31.358057 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-04da0437-6f33-48a9-85ac-aa41cfbb7597 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1681 microversion: 2.1 time: 0.148938 May 20 09:18:31.358615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 365/700] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:31 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:32.376595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:32.377295 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:32.379698 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:32.389007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:32.389414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:32.390203 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:32.393027 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:32.544770 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:32.552588 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5cfdfc22-b6e0-4330-867c-712b9422b15f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1681 microversion: 2.1 time: 0.180272 May 20 09:18:32.553143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 336/701] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:32 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:32.793183 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:32.794546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:32.797933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:32.803933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:32.804381 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:32.805130 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:32.805557 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:32.834651 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3f286f4e-d788-40fe-8c1f-bf53f9dc3ca8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046957 May 20 09:18:32.835160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 366/702] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:18:32 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:18:32.895433 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:32.895925 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:32.902091 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:32.902534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:32.903279 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:32.903735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:32.929100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:18:33.012252 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0f5f1e75-0aa1-478a-829d-236489a7cb42 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 204 len: 0 microversion: 2.1 time: 0.120693 May 20 09:18:33.013437 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 337/703] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:18:32 2022] DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:18:33.022351 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:33.023033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:33.031113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.031715 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.032479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.032911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.147977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:33.148559 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:33.154679 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.155117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.155903 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.156315 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.183625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:18:33.261152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8726657e-b14f-41fa-a971-386824664180 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 204 len: 0 microversion: 2.1 time: 0.117473 May 20 09:18:33.263612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:33.267362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 338/704] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:18:33 2022] DELETE /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:18:33.271976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-75521fd9-83a3-43d5-86cd-1f53365cead8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1673 microversion: 2.1 time: 0.254203 May 20 09:18:33.272546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 367/705] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:33 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1673 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:33.276691 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:33.277624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:33.283794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.284229 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.284981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.285401 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.418421 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:33.426062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-89abe6e0-96e5-47e6-9b29-7b7c08cb36b5 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1508 microversion: 2.1 time: 0.157421 May 20 09:18:33.426631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 339/706] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:33 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:33.570470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:33.571031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:33.577346 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.577767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.578522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.578956 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.681392 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:33.689023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3a7d3f9a-5757-4b3e-9607-da865ab04ea8 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1613 microversion: 2.1 time: 0.122767 May 20 09:18:33.689594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 368/707] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:33 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:33.795034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-06b5c64e-3a7d-48af-9d2c-20e9185842fa req-5b5526c9-7427-42bd-9e66-51be8399c764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e1e109-bd6a-4764-b404-03e02b059042", "name": "network-vif-deleted", "tag": "62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:33.803468 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-06b5c64e-3a7d-48af-9d2c-20e9185842fa req-5b5526c9-7427-42bd-9e66-51be8399c764 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:33.803903 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-06b5c64e-3a7d-48af-9d2c-20e9185842fa req-5b5526c9-7427-42bd-9e66-51be8399c764 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:33.816572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-06b5c64e-3a7d-48af-9d2c-20e9185842fa req-5b5526c9-7427-42bd-9e66-51be8399c764 service nova] Creating event network-vif-deleted:62ccf963-9cbe-4c3f-9b1e-4e4d3e4137ef for instance 03e1e109-bd6a-4764-b404-03e02b059042 on hv-cinder-83699 May 20 09:18:33.821599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-06b5c64e-3a7d-48af-9d2c-20e9185842fa req-5b5526c9-7427-42bd-9e66-51be8399c764 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030237 May 20 09:18:33.822167 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 340/708] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:34.289891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:34.290499 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:34.297406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:34.297827 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:34.298591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:34.299025 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:34.429608 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:34.437300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9f679bd0-8946-4f1a-95f1-da4340e18338 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1673 microversion: 2.1 time: 0.151423 May 20 09:18:34.438458 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 369/709] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:34 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:34.444354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:34.445177 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:34.452539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:34.453070 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:34.453905 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:34.454333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:34.593427 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:34.601341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dc108420-94c2-49f6-9c04-89fb6a5d71e9 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1508 microversion: 2.1 time: 0.161400 May 20 09:18:34.601898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 341/710] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:34 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:34.706437 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:34.707200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:34.714265 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:34.715017 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:34.715836 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:34.716350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:34.786370 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:34.794129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fb4cc15a-d6d8-4576-9646-a7287feb8e5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1613 microversion: 2.1 time: 0.091743 May 20 09:18:34.794702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 370/711] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:34 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:35.459665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:35.460630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:35.467648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:35.468093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:35.468856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:35.469288 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:35.487440 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:35.600787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:35.608907 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7fefd3dc-4fa6-4aab-a9a9-814debbbed6f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1673 microversion: 2.1 time: 0.155919 May 20 09:18:35.609482 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 342/712] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:35 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:35.618019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:35.618625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:35.625587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:35.626042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:35.626768 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:35.627194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:35.756962 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:35.769895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4021e7ec-fa58-4464-98f5-0329526dfaaa tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1508 microversion: 2.1 time: 0.155710 May 20 09:18:35.770472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 371/713] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:35 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:35.811416 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:35.812019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:35.818615 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:35.819058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:35.819881 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:35.820308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:35.895770 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:35.903355 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-97612f30-6f1e-42c7-8caf-9b5d139b562d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1326 microversion: 2.1 time: 0.095896 May 20 09:18:35.903827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 343/714] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:35 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:36.632404 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:36.633011 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:36.639895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.640336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.641084 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.641528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.779050 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:36.786964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8fe0a26d-14af-457f-b5cd-09bdaeb4fd4a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1673 microversion: 2.1 time: 0.162436 May 20 09:18:36.787403 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:36.787896 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 372/715] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:36 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:36.787988 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:36.794839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.795295 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.796064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.796483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.920618 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:36.921138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:36.928105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.928554 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.929377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.929822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.933143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:36.941034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-42885d30-7b21-4356-af29-164f0403dadf tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1508 microversion: 2.1 time: 0.157542 May 20 09:18:36.941942 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 344/716] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:36 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:36.968645 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:36.969086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:36.969531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lazy-loading 'fault' on Instance uuid 03e1e109-bd6a-4764-b404-03e02b059042 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:37.034096 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:37.042029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5e55f209-02cb-4b1d-b234-281ecf7b491e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 200 len: 1331 microversion: 2.1 time: 0.125412 May 20 09:18:37.042610 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 373/717] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:36 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:18:37.758195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-74664630-74ae-4bbb-a695-e9bd74d659f8 req-8ce2b1db-3e81-4000-b58c-3d3ec3158798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb33473-a994-427d-9822-3ff769987a56", "name": "network-vif-deleted", "tag": "7d1ab808-94ab-41bb-b7aa-8b530eb9862e"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:37.782422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-74664630-74ae-4bbb-a695-e9bd74d659f8 req-8ce2b1db-3e81-4000-b58c-3d3ec3158798 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:37.782939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-74664630-74ae-4bbb-a695-e9bd74d659f8 req-8ce2b1db-3e81-4000-b58c-3d3ec3158798 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:37.801309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-74664630-74ae-4bbb-a695-e9bd74d659f8 req-8ce2b1db-3e81-4000-b58c-3d3ec3158798 service nova] Creating event network-vif-deleted:7d1ab808-94ab-41bb-b7aa-8b530eb9862e for instance 7fb33473-a994-427d-9822-3ff769987a56 on hv-cinder-83699 May 20 09:18:37.804639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:37.805261 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:37.808899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-74664630-74ae-4bbb-a695-e9bd74d659f8 req-8ce2b1db-3e81-4000-b58c-3d3ec3158798 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053735 May 20 09:18:37.810446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 345/718] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:37.816542 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:37.817219 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:37.818173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:37.818785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:37.917144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:37.925527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b09fd63f-40d2-4822-af67-da4d60925641 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 200 len: 1606 microversion: 2.1 time: 0.125201 May 20 09:18:37.926552 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 374/719] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:37 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 1606 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:18:37.958875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:37.959879 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:37.967085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:37.967567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:37.968327 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:37.968748 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:37.999213 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:37.999682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:38.000121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lazy-loading 'fault' on Instance uuid 7fb33473-a994-427d-9822-3ff769987a56 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:38.046360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:38.054220 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a575333f-93f1-47f8-b0d4-c7454511003b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 200 len: 1312 microversion: 2.1 time: 0.099904 May 20 09:18:38.054937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 346/720] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:37 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:38.058890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:38.059667 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:38.066292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:38.066891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:38.067771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:38.068270 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:38.082680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 HTTP/1.1 May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:18:38.084743 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:18:38.086424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '03e1e109-bd6a-4764-b404-03e02b059042'} May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:38.087374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:18:38.088948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:38.090261 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:38.090261 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-768fdcf0-0fc3-4dbb-b171-89f73a3f6198 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 404 len: 111 microversion: 2.1 time: 0.033003 May 20 09:18:38.091649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 375/721] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:38 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:18:38.099878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-22072789-9460-45eb-b336-31ff0c53d66a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '.version_select at 0x7f7c876381f0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:38.125886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-22072789-9460-45eb-b336-31ff0c53d66a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968254911" status: 202 len: 0 microversion: 2.1 time: 0.030807 May 20 09:18:38.126478 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 347/722] 10.222.0.69 () {58 vars in 1217 bytes} [Fri May 20 09:18:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968254911 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:18:38.195671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-acd67376-61d4-4078-a94a-a9ddd6f0b18d req-fcd114b5-c6bd-499e-81d4-a32a372dac90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99280ff-b8f3-420b-ba9a-e6e5686de569", "name": "network-vif-deleted", "tag": "1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:38.208021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-acd67376-61d4-4078-a94a-a9ddd6f0b18d req-fcd114b5-c6bd-499e-81d4-a32a372dac90 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:38.208860 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-acd67376-61d4-4078-a94a-a9ddd6f0b18d req-fcd114b5-c6bd-499e-81d4-a32a372dac90 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:38.247732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-acd67376-61d4-4078-a94a-a9ddd6f0b18d req-fcd114b5-c6bd-499e-81d4-a32a372dac90 service nova] Creating event network-vif-deleted:1a1fc432-ef9f-4c71-9cb4-14f4d8bb9b05 for instance e99280ff-b8f3-420b-ba9a-e6e5686de569 on hv-cinder-83699 May 20 09:18:38.255797 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-acd67376-61d4-4078-a94a-a9ddd6f0b18d req-fcd114b5-c6bd-499e-81d4-a32a372dac90 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073113 May 20 09:18:38.257492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 376/723] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:38.899600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b94da1b5-2b03-4f31-a814-f8a5fbedda8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: .version_select at 0x7f7c90809700>, body: {"keypair": {"name": "tempest-keypair-982750132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhDJeFf5yhFmCCY8E8LQiskNZstqTWe26OAJ4xgA3ctdPXe64vw3ZnQ3EJ6OxbOoOYu+R3C3CpS5KAE1Tq8BgAiKnMBo0+IB/cHk9hBU9+NZvH/vTIbSVaROpnz6gDYIA=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:38.915108 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-b94da1b5-2b03-4f31-a814-f8a5fbedda8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:18:38.919066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-b94da1b5-2b03-4f31-a814-f8a5fbedda8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:18:38.943947 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b94da1b5-2b03-4f31-a814-f8a5fbedda8a tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048555 May 20 09:18:38.949899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 348/724] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:18:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:39.061156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:39.061854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:39.070830 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:39.071472 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: 7fb33473-a994-427d-9822-3ff769987a56] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:39.079319 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.079763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.080536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.080962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.082861 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.083515 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.084453 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.087121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.106059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] HTTP exception thrown: Instance 7fb33473-a994-427d-9822-3ff769987a56 could not be found. May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Request method failure captured: May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 HTTP/1.1 May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1u0gzpwdtG3vy6mWamlIc0JNfTDCKnkS4SIiO2QpGgBLv6VLtVhm2Cx_-q7ygegAF8h1To5N5kpqxz6Obju8-I-oeEi0a91uAEw1KPehzRdb2mo9x3dF4fWRK15gOa7xynHPgCsfX5DVcj5xwy3flzTJPmMWW_d_9JU7Rlcyay0sTE May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:18:39.108335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed0e52a9d6374123b57759435d43d7aa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}] May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 992571802b7d426f923e0f0bc41e28de May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 7fb33473-a994-427d-9822-3ff769987a56 could not be found. May 20 09:18:39.109897 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '7fb33473-a994-427d-9822-3ff769987a56'} May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb33473-a994-427d-9822-3ff769987a56 could not be found. May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:39.110771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb33473-a994-427d-9822-3ff769987a56 could not be found. May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb33473-a994-427d-9822-3ff769987a56 could not be found. May 20 09:18:39.112172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:18:39.113428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] HTTP exception thrown: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:18:39.114524 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Returning 404 to user: Instance 7fb33473-a994-427d-9822-3ff769987a56 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Request method failure captured: May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 HTTP/1.1 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vAmwwX9ChFgdWDaEZEF1AWwlRZOX6hb7SJpuDd1OZ0SXUuQREBohBSryd-dnW6bhdprojHhoH5aWonHuxOm6LOKBcAUX81fTLFpJzXWjeqkrff7RWrh9kXlm80kOeZJNgqtXLi4F0pHeIki64z3oK9aSw6pSysYGyZNWeVQYKW6p0 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:18:39.115279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dd35ce1fcbd4038a0c556a45059c7d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}] May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeTestJSON-1945366603 May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: bfaaa367491745708334c5f35331bf76 May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:18:39.117099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'e99280ff-b8f3-420b-ba9a-e6e5686de569'} May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:39.117847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:18:39.119039 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:39.120131 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-57836a84-1b83-4147-b23e-aabde5e8b95d tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56" status: 404 len: 111 microversion: 2.1 time: 0.048931 May 20 09:18:39.120231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Returning 404 to user: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:39.120320 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 349/725] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:39 2022] GET /compute/v2.1/servers/7fb33473-a994-427d-9822-3ff769987a56 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:18:39.120418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c841cc54-bf28-41a9-bb17-01b1a2fb7b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 404 len: 111 microversion: 2.1 time: 0.178509 May 20 09:18:39.120418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 377/726] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:38 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:18:39.127942 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d11fc6b0-2d5b-4de7-83d9-b0eb11bc59a0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '.version_select at 0x7f7c876384c0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:39.129054 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:39.129737 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:39.136918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.137595 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.138419 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.139809 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.149962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d11fc6b0-2d5b-4de7-83d9-b0eb11bc59a0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564569844" status: 202 len: 0 microversion: 2.1 time: 0.026293 May 20 09:18:39.150520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 350/727] 10.222.0.69 () {58 vars in 1220 bytes} [Fri May 20 09:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564569844 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:18:39.341322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:18:39.359691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:39.446143 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-015b7e1a-eae0-469f-99f6-94d20e0d421b tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 204 len: 0 microversion: 2.1 time: 0.322296 May 20 09:18:39.447136 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 378/728] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:18:39 2022] DELETE /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 20 09:18:39.456290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:39.457018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:39.465146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.465582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.466846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:39.467318 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:39.752220 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:39.760427 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-86144fcc-dada-47d1-ae21-7188e96834ad tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.308808 May 20 09:18:39.761000 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 351/729] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:39 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:40.475746 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c80559ca-16c1-40d3-90c9-3e9a43140b2f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: .version_select at 0x7f7c86cf5940>, body: {"keypair": {"name": "tempest-keypair-817386003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnz6eUEG1i6oiFE9dtivdM3a6AZer9Ua0gd+1oGgKqGaH6RH0jNOw8s/qyrbzc+N9/vOD77EwPzqOMCUXBansJkWHNDisNzBVAta3w4A/WkYGVuXQsv0b+v5FlPPUGzWg=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:40.489678 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-c80559ca-16c1-40d3-90c9-3e9a43140b2f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:18:40.493599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-c80559ca-16c1-40d3-90c9-3e9a43140b2f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for user bfaaa367491745708334c5f35331bf76 and project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:18:40.521056 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c80559ca-16c1-40d3-90c9-3e9a43140b2f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049063 May 20 09:18:40.521464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 379/730] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:18:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:40.778726 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:40.779536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:40.786066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:40.786586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:40.787467 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:40.787955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:41.069997 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:41.078799 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f660d9d4-e69f-4d70-b6bf-a235a43c6b9c tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.304543 May 20 09:18:41.079941 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 352/731] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:40 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:41.148998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-207084473", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "328df357-f834-447d-8616-ac57cd7979a2"}], "security_groups": [{"name": "tempest-securitygroup--1239681695"}], "key_name": "tempest-keypair-982750132", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:41.300695 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] validate_networks() for [('328df357-f834-447d-8616-ac57cd7979a2', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:18:42.096476 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:42.097123 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:42.103993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:42.104441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:42.105210 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:42.105662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:42.144781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:18:42.145340 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:18:42.145911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:18:42.147716 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:18:42.147716 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:18:42.159769 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:42.160209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:42.161091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:42.161576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:42.180293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:18:42.184340 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Getting quotas for user ff944e4cf29b4297acc63b591d90daaf and project 2ddfd22e3dde4cc89c073bd2d88d648b. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:18:42.195968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:18:42.198442 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:18:42.244387 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:42.252031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-32817035-21be-4cd8-a9ad-b6d8dd614544 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1521 microversion: 2.1 time: 0.159480 May 20 09:18:42.252892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 353/732] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:42 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:42.265542 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-725e138b-5974-4e58-a5c2-a0a21567c2ad tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.122887 May 20 09:18:42.266848 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 380/733] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:18:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 20 09:18:42.277058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57ca8686-e988-4c7e-a99d-316e2c1bf80e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:42.277946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-57ca8686-e988-4c7e-a99d-316e2c1bf80e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:42.336885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57ca8686-e988-4c7e-a99d-316e2c1bf80e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:42.343593 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-57ca8686-e988-4c7e-a99d-316e2c1bf80e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1240 microversion: 2.1 time: 0.070293 May 20 09:18:42.353220 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 354/734] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:42 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:42.535641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-338466511", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1877e401-d42a-4a52-b633-242e6f958903"}], "security_groups": [{"name": "tempest-securitygroup--1148517198"}], "key_name": "tempest-keypair-817386003", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:42.672812 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] validate_networks() for [('1877e401-d42a-4a52-b633-242e6f958903', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:18:43.270173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:43.271580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:43.278867 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.279450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.280737 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.281388 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.284803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:18:43.285311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:18:43.285798 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:18:43.287870 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:18:43.288350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:18:43.302002 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.303015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.304267 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.305007 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.370243 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:18:43.375400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Getting quotas for user bfaaa367491745708334c5f35331bf76 and project 9dd35ce1fcbd4038a0c556a45059c7d7. Resources: {'ram', 'cores', 'instances'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:18:43.391874 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:18:43.394974 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:18:43.449875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992571802b7d426f923e0f0bc41e28de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0e52a9d6374123b57759435d43d7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:43.458597 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bb98094d-e124-4a79-955b-68eebaca9e05 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 200 len: 1479 microversion: 2.1 time: 0.192614 May 20 09:18:43.461918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-099b9ab7-47ff-41ba-b88e-b9a908d1cdd0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.931022 May 20 09:18:43.464628 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 355/735] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:43 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 1479 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:43.469973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 381/736] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:18:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:18:43.477308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-950d6ba3-e89a-4deb-87ee-26d23c8f4363 req-adb52924-d135-4458-90a1-d1efa51986a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97bdede-0305-4f4b-bc04-8b659b1c88ce", "name": "network-vif-deleted", "tag": "5dbf97e0-97de-43b0-acce-908bce8975fe"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:43.478697 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:43.479524 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:43.490707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-950d6ba3-e89a-4deb-87ee-26d23c8f4363 req-adb52924-d135-4458-90a1-d1efa51986a0 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.490707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-950d6ba3-e89a-4deb-87ee-26d23c8f4363 req-adb52924-d135-4458-90a1-d1efa51986a0 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.502024 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.502464 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.510942 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:43.513075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:43.520465 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-950d6ba3-e89a-4deb-87ee-26d23c8f4363 req-adb52924-d135-4458-90a1-d1efa51986a0 service nova] Creating event network-vif-deleted:5dbf97e0-97de-43b0-acce-908bce8975fe for instance a97bdede-0305-4f4b-bc04-8b659b1c88ce on hv-cinder-83699 May 20 09:18:43.536835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-950d6ba3-e89a-4deb-87ee-26d23c8f4363 req-adb52924-d135-4458-90a1-d1efa51986a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067535 May 20 09:18:43.537467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 382/737] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:43.546477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-495f352d-88cb-4da0-90d4-84b994580fc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:43.547397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-495f352d-88cb-4da0-90d4-84b994580fc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:43.613201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-495f352d-88cb-4da0-90d4-84b994580fc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:43.622016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-495f352d-88cb-4da0-90d4-84b994580fc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1236 microversion: 2.1 time: 0.083019 May 20 09:18:43.627307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 383/738] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:43 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:43.632751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:43.641095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-41e13a57-7338-4188-9e20-561d0a57bc5b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1310 microversion: 2.1 time: 0.169397 May 20 09:18:43.642021 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 356/739] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:43 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:44.475504 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:44.476420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] [instance: a97bdede-0305-4f4b-bc04-8b659b1c88ce] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:44.484831 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:44.485837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:44.487433 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:44.488093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:44.522049 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] HTTP exception thrown: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce could not be found. May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Request method failure captured: May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce HTTP/1.1 May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1u0gzpwdtG3vy6mWamlIc0JNfTDCKnkS4SIiO2QpGgBLv6VLtVhm2Cx_-q7ygegAF8h1To5N5kpqxz6Obju8-I-oeEi0a91uAEw1KPehzRdb2mo9x3dF4fWRK15gOa7xynHPgCsfX5DVcj5xwy3flzTJPmMWW_d_9JU7Rlcyay0sTE May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:18:44.527664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ed0e52a9d6374123b57759435d43d7aa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ed0e52a9d6374123b57759435d43d7aa"}]}] May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: ed0e52a9d6374123b57759435d43d7aa May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457916596 May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: 992571802b7d426f923e0f0bc41e28de May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457916596-project May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce could not be found. May 20 09:18:44.529263 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'a97bdede-0305-4f4b-bc04-8b659b1c88ce'} May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce could not be found. May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:18:44.530113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce could not be found. May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce could not be found. May 20 09:18:44.531635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:18:44.533410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] Returning 404 to user: Instance a97bdede-0305-4f4b-bc04-8b659b1c88ce could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:18:44.534496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bc6825bf-01fa-41b6-adc9-f894cd5eacc6 tempest-ServerRescueNegativeTestJSON-457916596 tempest-ServerRescueNegativeTestJSON-457916596-project] 10.222.0.69 "GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce" status: 404 len: 111 microversion: 2.1 time: 0.063361 May 20 09:18:44.542189 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 384/740] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:44 2022] GET /compute/v2.1/servers/a97bdede-0305-4f4b-bc04-8b659b1c88ce => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:18:44.642044 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:44.642779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:44.650506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:44.651138 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:44.659208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:44.659747 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:44.670823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:44.670823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:44.677339 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:44.678392 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:44.680902 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:44.682563 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:44.836982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:44.845345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1133afc9-6a9b-4bf6-b30e-5a4208532e14 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1294 microversion: 2.1 time: 0.208302 May 20 09:18:44.846069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 357/741] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:44 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1294 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:18:45.055620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:45.077279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a8ecf5e0-f04e-4dc1-8e0a-b4bfaae2c387 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.422845 May 20 09:18:45.078460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 385/742] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:44 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:45.308409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-637dbf25-cb1d-4539-8a81-a6118570fea4 req-84b44b1a-23c8-41d7-9f8e-9712c85a5f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a803a923-432b-49f2-8495-8db38c6e44e1", "tag": "449fbc31-4c62-4d87-bf2d-b96937911200"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:45.325992 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-637dbf25-cb1d-4539-8a81-a6118570fea4 req-84b44b1a-23c8-41d7-9f8e-9712c85a5f78 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:45.327722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-637dbf25-cb1d-4539-8a81-a6118570fea4 req-84b44b1a-23c8-41d7-9f8e-9712c85a5f78 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:45.346876 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-637dbf25-cb1d-4539-8a81-a6118570fea4 req-84b44b1a-23c8-41d7-9f8e-9712c85a5f78 service nova] Creating event network-changed:449fbc31-4c62-4d87-bf2d-b96937911200 for instance a803a923-432b-49f2-8495-8db38c6e44e1 on hv-cinder-83699 May 20 09:18:45.353067 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-637dbf25-cb1d-4539-8a81-a6118570fea4 req-84b44b1a-23c8-41d7-9f8e-9712c85a5f78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050996 May 20 09:18:45.353724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 358/743] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:45.862999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:45.863611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:45.870992 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:45.871499 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:45.872335 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:45.872797 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:46.014863 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:46.023051 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-49e0f452-5183-4bab-a316-56859cbac36d tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1294 microversion: 2.1 time: 0.164180 May 20 09:18:46.023667 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 386/744] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:45 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1294 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:46.096202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:46.096996 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:46.103698 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:46.104144 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:46.104935 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:46.105378 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:46.264195 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:46.274382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-38ec04be-7bb2-4195-93ca-682702a26a6b tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.182589 May 20 09:18:46.275719 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 359/745] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:46 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:47.039943 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:47.040548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:47.047698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:47.048345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:47.049286 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:47.049714 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:47.292176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:47.292749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:47.299646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:47.300095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:47.300861 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:47.301308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:47.328927 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:47.339043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2f3175e3-38e9-4c91-b135-2d229e8981b0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.303559 May 20 09:18:47.339915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 387/746] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:47 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:47.457653 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:47.466398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-12a6453f-da5e-4fb0-b47f-489f4d7342ee tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.178483 May 20 09:18:47.467065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 360/747] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:47 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:47.861614 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-37eb893d-2692-4456-8706-7c8505104729 req-7b4109b0-9110-43aa-ade5-1ad070d8588f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a725791-6ff4-480f-8bce-77731edd3aad", "tag": "6c738cd6-fb28-423a-8cab-3d62c2f21538"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:47.883042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-37eb893d-2692-4456-8706-7c8505104729 req-7b4109b0-9110-43aa-ade5-1ad070d8588f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:47.883759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-37eb893d-2692-4456-8706-7c8505104729 req-7b4109b0-9110-43aa-ade5-1ad070d8588f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:47.913544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-37eb893d-2692-4456-8706-7c8505104729 req-7b4109b0-9110-43aa-ade5-1ad070d8588f service nova] Creating event network-changed:6c738cd6-fb28-423a-8cab-3d62c2f21538 for instance 1a725791-6ff4-480f-8bce-77731edd3aad on hv-cinder-83699 May 20 09:18:47.920560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-37eb893d-2692-4456-8706-7c8505104729 req-7b4109b0-9110-43aa-ade5-1ad070d8588f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063805 May 20 09:18:47.921833 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 388/748] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:48.356745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:48.357893 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:48.365313 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:48.365735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:48.366951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:48.367471 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:48.486138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:48.487094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:48.495155 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:48.495893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:48.497073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:48.497717 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:48.506736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:48.515643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-65d0120b-2f6a-49e6-bc5d-ef109a72b854 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.162679 May 20 09:18:48.519541 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 361/749] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:48 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:48.804492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:48.812678 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5f2cacae-9763-4a98-bbe0-5b56f0546130 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.331887 May 20 09:18:48.813239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 389/750] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:48 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:49.538483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:49.539807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:49.546665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:49.547448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:49.548390 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:49.548829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:49.687095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:49.695625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-34b33398-5868-4c03-83a8-a19617649530 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.161149 May 20 09:18:49.696430 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 362/751] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:49 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:49.830064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:49.830596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:49.833269 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:49.838932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:49.839595 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:49.840511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:49.841093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:50.164677 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:50.173691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fc45acd0-3152-4f08-bdd3-19d0e3a8c3c2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.348059 May 20 09:18:50.174275 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 390/752] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:49 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:50.713718 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:50.714513 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:50.720889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:50.721335 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:50.722100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:50.722528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:50.853639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:50.860991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d76fe2da-6f9b-4f4b-bfa4-505996d0ee40 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.151396 May 20 09:18:50.861552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 363/753] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:50 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:51.191285 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:51.192201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:51.198470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:51.199110 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:51.199893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:51.200306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:51.347725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:51.357091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-276c4855-1acf-4304-a11c-e915e3419eff tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.169686 May 20 09:18:51.357991 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 391/754] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:51 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:51.489981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-4ef47dad-7f39-476b-8b7c-65b280733694 req-69854301-f9c3-45be-9fa3-e64a578c2249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a803a923-432b-49f2-8495-8db38c6e44e1", "name": "network-vif-plugged", "status": "completed", "tag": "449fbc31-4c62-4d87-bf2d-b96937911200"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:51.499397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-4ef47dad-7f39-476b-8b7c-65b280733694 req-69854301-f9c3-45be-9fa3-e64a578c2249 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:51.499844 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-4ef47dad-7f39-476b-8b7c-65b280733694 req-69854301-f9c3-45be-9fa3-e64a578c2249 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:51.513132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-4ef47dad-7f39-476b-8b7c-65b280733694 req-69854301-f9c3-45be-9fa3-e64a578c2249 service nova] Creating event network-vif-plugged:449fbc31-4c62-4d87-bf2d-b96937911200 for instance a803a923-432b-49f2-8495-8db38c6e44e1 on hv-cinder-83699 May 20 09:18:51.519925 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-4ef47dad-7f39-476b-8b7c-65b280733694 req-69854301-f9c3-45be-9fa3-e64a578c2249 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035511 May 20 09:18:51.520531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 364/755] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:18:51.878531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:51.879235 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:51.887486 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:51.887927 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:51.889064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:51.889600 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:52.033129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:52.040847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9716af25-4185-496d-98ed-473ce9a9d1f3 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.166850 May 20 09:18:52.041419 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 392/756] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:51 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:52.374495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:52.381217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:52.382258 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:52.388975 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:52.389414 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:52.390163 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:52.390599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:52.408703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:52.526311 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:52.533927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e8e2d62a-61d2-402f-ad6e-595bbaf05cda tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1366 microversion: 2.1 time: 0.162011 May 20 09:18:52.534496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 365/757] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:52 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:52.774456 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8b2b5ca9-2f8a-4807-bf36-cfed887946f0 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c86c96280>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:52.826008 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8b2b5ca9-2f8a-4807-bf36-cfed887946f0 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/b8d3b6fc-c4a8-470c-87e7-7f0e9ad50d51" status: 200 len: 349 microversion: 2.1 time: 0.060113 May 20 09:18:52.826616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 393/758] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:18:52 2022] GET /compute/v2.1/os-volumes/b8d3b6fc-c4a8-470c-87e7-7f0e9ad50d51 => generated 349 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:53.059827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:53.060455 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:53.066899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.067386 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.068169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.068593 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.211658 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:53.219614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-92b4d2c4-213d-4f56-8092-d62d481e0d9b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.165937 May 20 09:18:53.220864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 366/759] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:53 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:53.549602 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=4 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:53.555179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-84a19696-0522-4a49-a4fb-1e408e48b9dc req-95db831f-dc32-4416-8319-1c06c93ed55c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a725791-6ff4-480f-8bce-77731edd3aad", "name": "network-vif-plugged", "status": "completed", "tag": "6c738cd6-fb28-423a-8cab-3d62c2f21538"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:53.555422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:53.556010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:53.562979 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.563469 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.563855 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-84a19696-0522-4a49-a4fb-1e408e48b9dc req-95db831f-dc32-4416-8319-1c06c93ed55c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.564225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.564368 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-84a19696-0522-4a49-a4fb-1e408e48b9dc req-95db831f-dc32-4416-8319-1c06c93ed55c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.564652 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.575721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-84a19696-0522-4a49-a4fb-1e408e48b9dc req-95db831f-dc32-4416-8319-1c06c93ed55c service nova] Creating event network-vif-plugged:6c738cd6-fb28-423a-8cab-3d62c2f21538 for instance 1a725791-6ff4-480f-8bce-77731edd3aad on hv-cinder-83699 May 20 09:18:53.580829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-84a19696-0522-4a49-a4fb-1e408e48b9dc req-95db831f-dc32-4416-8319-1c06c93ed55c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 May 20 09:18:53.581765 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 394/760] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:53.701659 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:53.709232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e83f69fa-9086-4474-84ff-9145b1c3382d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1556 microversion: 2.1 time: 0.160387 May 20 09:18:53.709866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 367/761] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:53 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:53.727849 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:53.728451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:53.730444 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=18 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:53.736402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.737079 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.737847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:53.738294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:53.848546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-74cfbb37-b800-4c43-9973-bc98a5381fac tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124649 May 20 09:18:53.849428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 395/762] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:18:53 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:54.152245 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f182308e-a396-430a-a17a-71e12e162172 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c90809940>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:54.204061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f182308e-a396-430a-a17a-71e12e162172 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7ae9d185-151b-4108-bc4d-01ad9e7dc8a5" status: 200 len: 350 microversion: 2.1 time: 0.055589 May 20 09:18:54.204631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 368/763] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:18:54 2022] GET /compute/v2.1/os-volumes/7ae9d185-151b-4108-bc4d-01ad9e7dc8a5 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:54.237479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:54.238168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:54.245555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:54.246194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:54.247215 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:54.247754 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:54.479917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:54.487959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8c306beb-c611-402a-9c7c-3f0af68b8283 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1362 microversion: 2.1 time: 0.254472 May 20 09:18:54.497320 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 396/764] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:54 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:55.125345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-327b465a-eb6d-43b9-bdd3-47afe043c4d2 req-c6d8d937-7817-4d80-a98c-18a4e501f65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a803a923-432b-49f2-8495-8db38c6e44e1", "tag": "449fbc31-4c62-4d87-bf2d-b96937911200"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:55.134231 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-327b465a-eb6d-43b9-bdd3-47afe043c4d2 req-c6d8d937-7817-4d80-a98c-18a4e501f65d service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:55.134666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-327b465a-eb6d-43b9-bdd3-47afe043c4d2 req-c6d8d937-7817-4d80-a98c-18a4e501f65d service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:55.145646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-327b465a-eb6d-43b9-bdd3-47afe043c4d2 req-c6d8d937-7817-4d80-a98c-18a4e501f65d service nova] Creating event network-changed:449fbc31-4c62-4d87-bf2d-b96937911200 for instance a803a923-432b-49f2-8495-8db38c6e44e1 on hv-cinder-83699 May 20 09:18:55.150692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-327b465a-eb6d-43b9-bdd3-47afe043c4d2 req-c6d8d937-7817-4d80-a98c-18a4e501f65d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029668 May 20 09:18:55.151496 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 369/765] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:55.506016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.507715 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:55.524863 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:55.525552 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:55.526730 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:55.527433 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:55.540699 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a015424-2284-4f20-89df-e60e44699eef tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c9082e1f0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.596349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a015424-2284-4f20-89df-e60e44699eef tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3999785c-debd-43a1-a320-3c9c28fa198f" status: 200 len: 350 microversion: 2.1 time: 0.061304 May 20 09:18:55.596916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 370/766] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/os-volumes/3999785c-debd-43a1-a320-3c9c28fa198f => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:55.608339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4f1d5ed5-fbac-4654-b278-47673717ad7f tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c9085e0d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.691625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4f1d5ed5-fbac-4654-b278-47673717ad7f tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.086978 May 20 09:18:55.692443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 371/767] 10.222.0.69 () {58 vars in 1133 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:55.704339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cade4158-25e3-48a6-aa1e-984adcadaf04 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c9084ae50>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.762452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:55.791549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7648cceb-759f-496a-b3a9-99bc940301de tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1549 microversion: 2.1 time: 0.290019 May 20 09:18:55.800802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 397/768] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1549 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:55.801367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cade4158-25e3-48a6-aa1e-984adcadaf04 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095876 May 20 09:18:55.801367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 372/769] 10.222.0.69 () {58 vars in 1148 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:18:55.809950 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.810438 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ba170eee-c5a2-40ea-8cf1-f1be13d4ad59 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c86cef9d0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.810799 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:55.817439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:55.818097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:55.820229 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:55.820673 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:55.906865 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ba170eee-c5a2-40ea-8cf1-f1be13d4ad59 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.101090 May 20 09:18:55.907766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 398/770] 10.222.0.69 () {58 vars in 1133 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:55.918593 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-485de6df-39f4-4dba-8182-1807548520ce tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c86e09f70>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:55.924916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-278eaaf1-6a17-428a-b35d-c89dffaf992e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119032 May 20 09:18:55.925509 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 373/771] 10.222.0.69 () {58 vars in 1274 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:18:56.018629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-485de6df-39f4-4dba-8182-1807548520ce tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103551 May 20 09:18:56.019221 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 399/772] 10.222.0.69 () {58 vars in 1166 bytes} [Fri May 20 09:18:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:56.031286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c1d34a9c-e495-40ee-9332-bdc21bf4215a tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c87614820>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:56.116520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c1d34a9c-e495-40ee-9332-bdc21bf4215a tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089212 May 20 09:18:56.117085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 374/773] 10.222.0.69 () {58 vars in 1169 bytes} [Fri May 20 09:18:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:56.128759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-697bd2d6-0e21-42f0-9e17-6cc60c5b93a6 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c86cf5f70>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:56.214058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-697bd2d6-0e21-42f0-9e17-6cc60c5b93a6 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.088893 May 20 09:18:56.214643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 400/774] 10.222.0.69 () {58 vars in 1154 bytes} [Fri May 20 09:18:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:56.226587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2dcb2787-a320-4fb3-a787-71fa58ef29f8 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c9082e670>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:56.308578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2dcb2787-a320-4fb3-a787-71fa58ef29f8 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086756 May 20 09:18:56.309144 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 375/775] 10.222.0.69 () {58 vars in 1187 bytes} [Fri May 20 09:18:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:56.322184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-17d6d936-da19-4bd1-aee1-bf74066fe662 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] Calling method '.version_select at 0x7f7c86cf5d30>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:56.411947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-17d6d936-da19-4bd1-aee1-bf74066fe662 tempest-VolumesTestJSON-551451016 tempest-VolumesTestJSON-551451016-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.095023 May 20 09:18:56.419449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 401/776] 10.222.0.69 () {58 vars in 1154 bytes} [Fri May 20 09:18:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:18:56.529155 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:56.529809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:56.539490 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:56.539936 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:56.540705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:56.541134 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:56.573706 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cb60d809-5bc2-431e-81c5-2836d4df01d1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/ips" status: 200 len: 151 microversion: 2.20 time: 0.241161 May 20 09:18:56.574248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 376/777] 10.222.0.69 () {60 vars in 1288 bytes} [Fri May 20 09:18:56 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/ips => generated 151 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:18:57.235351 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-7bc8b274-ca57-4a19-8965-f71109431288 req-e1a9d68a-f9b7-4a83-b8eb-3724f2d27ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a725791-6ff4-480f-8bce-77731edd3aad", "tag": "6c738cd6-fb28-423a-8cab-3d62c2f21538"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:57.243927 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-7bc8b274-ca57-4a19-8965-f71109431288 req-e1a9d68a-f9b7-4a83-b8eb-3724f2d27ea1 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:57.244341 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-7bc8b274-ca57-4a19-8965-f71109431288 req-e1a9d68a-f9b7-4a83-b8eb-3724f2d27ea1 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:57.254725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-7bc8b274-ca57-4a19-8965-f71109431288 req-e1a9d68a-f9b7-4a83-b8eb-3724f2d27ea1 service nova] Creating event network-changed:6c738cd6-fb28-423a-8cab-3d62c2f21538 for instance 1a725791-6ff4-480f-8bce-77731edd3aad on hv-cinder-83699 May 20 09:18:57.260016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-7bc8b274-ca57-4a19-8965-f71109431288 req-e1a9d68a-f9b7-4a83-b8eb-3724f2d27ea1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093235 May 20 09:18:57.260606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 402/778] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:18:58.951579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:18:58.952373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:58.955913 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:18:58.963842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:58.964330 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:58.965232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:58.965667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:58.992250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lazy-loading 'flavor' on Instance uuid 53b8a799-7b88-4862-8b6d-87faa7d907f8 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:18:59.257362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6021f849-db91-4b61-8693-8a7b4b27ca1b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/action" status: 202 len: 0 microversion: 2.20 time: 0.311564 May 20 09:18:59.257995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 377/779] 10.222.0.69 () {62 vars in 1318 bytes} [Fri May 20 09:18:58 2022] POST /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 20 09:18:59.267451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:18:59.268702 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:18:59.275127 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:59.275622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:59.276517 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:18:59.276890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:18:59.415160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:59.423138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:59.424758 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:18:59.425949 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f4ba28b3-c07f-4bf4-910b-9b99b579ec81 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.163383 May 20 09:18:59.426501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 403/780] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:18:59 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:00.445821 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:00.446571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:00.453273 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:00.453716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:00.454485 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:00.454902 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:00.599978 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:00.609013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:00.610642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:00.611863 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9b579124-2389-4a96-bc86-1fd22093da76 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.171031 May 20 09:19:00.612617 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 378/781] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:00 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:01.632126 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:01.633420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:01.642872 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:01.643707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:01.644482 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:01.644873 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:01.778589 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:01.786994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:01.788521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:01.789727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8d647711-a90f-4693-8bf5-25ee74a969e4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.163724 May 20 09:19:01.790272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 404/782] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:01 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:02.808072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:02.808680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:02.815871 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:02.816319 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:02.817077 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:02.817511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:02.958253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:02.966700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:02.968240 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:02.969442 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c8d7ab11-f6ee-470d-9248-72ec77b75f9e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.165332 May 20 09:19:02.969996 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 379/783] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:02 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:03.993931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:03.994730 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:04.003958 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:04.004548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:04.005549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:04.006122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:04.141496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:04.150834 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:04.152378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:04.153586 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c5bb059e-8a81-4955-82d4-a41ebc48aec7 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.165998 May 20 09:19:04.154376 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 405/784] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:03 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:05.172346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:05.172951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:05.179747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:05.180263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:05.181033 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:05.181465 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:05.311102 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:05.320478 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:05.323109 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:05.324346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b7b80014-5cfa-4fda-b981-f0f5f3b03f84 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.156021 May 20 09:19:05.324899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 380/785] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:05 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:06.345215 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:06.345828 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:06.352858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:06.353309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:06.354069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:06.354501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:06.358613 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:06.487184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:06.495579 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:06.497000 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:06.498162 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c77a0607-e015-48c1-bdef-92532fdeb1be tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.156973 May 20 09:19:06.498724 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 406/786] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:06 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:07.520401 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:07.521502 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:07.532587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:07.533328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:07.534575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:07.535326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:07.678667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:07.686791 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:07.688329 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:07.689485 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-42e0b07c-b035-4928-95f8-029d25611b43 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.176090 May 20 09:19:07.690046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 381/787] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:07 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:08.717210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:08.717210 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:08.723478 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:08.723864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:08.724636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:08.725060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:08.859114 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:08.867902 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:08.869447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:08.870633 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c70bce88-eb56-4dd4-8618-1c8025478096 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.160809 May 20 09:19:08.871193 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 407/788] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:08 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:09.893455 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:09.894264 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:09.902470 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:09.902917 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:09.903705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:09.904165 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:10.035887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:10.045800 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:10.048364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:10.050715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4320ae6e-1361-44ba-aef2-45f5b74a7832 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.161500 May 20 09:19:10.051680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 382/789] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:09 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:11.070430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:11.070975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:11.078101 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:11.078548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:11.079293 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:11.079745 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:11.213029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:11.221234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:11.222840 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:11.224118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c9a26da8-da9c-4deb-b149-340a0723bc3c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.157805 May 20 09:19:11.224802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 408/790] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:11 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:12.242151 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:12.242747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:12.250040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:12.250513 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:12.251299 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:12.251906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:12.386087 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:12.394729 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:12.396253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:12.397459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c382eb6b-308e-42b2-9423-3518095be201 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.159230 May 20 09:19:12.398019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 383/791] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:12 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:13.415629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:13.416228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:13.423115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:13.423588 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:13.424345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:13.424780 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:13.560513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:13.568779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:13.570527 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:13.571841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6b250a14-3514-4960-9827-435a3ae6d8c4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.160083 May 20 09:19:13.572464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 409/792] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:13 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:14.589971 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:14.590516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:14.597333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:14.597801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:14.598610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:14.599039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:14.741288 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:14.749964 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:14.752394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:14.753590 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f2290596-c4a8-4e6e-8d56-23117ae13628 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.167846 May 20 09:19:14.754143 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 384/793] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:14 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:15.780432 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:15.781652 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:15.789101 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:15.789650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:15.790566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:15.791069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:15.922856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:15.931020 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:15.932591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:15.933812 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-747bc7bb-24ee-4a60-9244-6f8815dfa6d8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1742 microversion: 2.20 time: 0.159244 May 20 09:19:15.934376 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 410/794] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:15 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:16.956522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:16.957228 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:16.965595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:16.966221 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:16.967313 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:16.967922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:17.100946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:17.109489 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:17.110993 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:17.112194 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0bcc3a19-05df-4f8c-aba8-e3de6f537635 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1742 microversion: 2.20 time: 0.162023 May 20 09:19:17.112750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 385/795] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:16 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:18.130530 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:18.131138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:18.137900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:18.138431 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:18.139251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:18.139791 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:18.275395 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:18.283519 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:18.285018 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:18.286206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-24f66652-4399-497b-9e90-c3f1e763b8e8 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.159989 May 20 09:19:18.286784 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 411/796] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:18 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:19.305799 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:19.307000 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:19.314680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:19.315459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:19.316881 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:19.317471 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:19.484626 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:19.497146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:19.499290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:19.500683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a1fd748-b7cf-4a07-82e9-ae3794086da3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.199729 May 20 09:19:19.502169 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 386/797] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:19 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:19.864709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-da18e851-b5a9-41ce-b33d-ccb4b51079bb req-98997906-14b3-4fa0-ac4e-193330f78491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "name": "network-vif-plugged", "status": "completed", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:19.868440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=34 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:19.874310 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-da18e851-b5a9-41ce-b33d-ccb4b51079bb req-98997906-14b3-4fa0-ac4e-193330f78491 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:19.874748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-da18e851-b5a9-41ce-b33d-ccb4b51079bb req-98997906-14b3-4fa0-ac4e-193330f78491 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:19.890386 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-da18e851-b5a9-41ce-b33d-ccb4b51079bb req-98997906-14b3-4fa0-ac4e-193330f78491 service nova] Creating event network-vif-plugged:0fff114c-fe55-4714-bbdc-e879108b685e for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 on hv-cinder-83699 May 20 09:19:19.896211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-da18e851-b5a9-41ce-b33d-ccb4b51079bb req-98997906-14b3-4fa0-ac4e-193330f78491 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269761 May 20 09:19:19.900340 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 412/798] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:20.519041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:20.519807 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:20.528749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:20.529202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:20.530106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:20.530536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:20.551862 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:20.677501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:20.685811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:20.687440 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:20.689032 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b1226881-c3f6-4e5e-a081-2e738aa60fd3 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.174467 May 20 09:19:20.690089 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 387/799] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:20 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:21.708803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:21.710115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:21.717605 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:21.718313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:21.722102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:21.722566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:21.916180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:21.924830 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:21.926432 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:21.928086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d8068dba-e5e2-4e7a-9f83-bf6690dcc377 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.223381 May 20 09:19:21.930591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 413/800] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:21 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:22.948404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:22.949857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:22.957440 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:22.957877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:22.958767 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:22.959294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:23.146795 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:23.158400 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:23.160768 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:23.162256 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e5e912c0-79b2-4231-b3d0-549c8699116f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.218559 May 20 09:19:23.175099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 388/801] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:22 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:24.185235 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:24.186932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:24.193566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:24.194161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:24.195048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:24.202416 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:24.396445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:24.405322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:24.406816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:24.408019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f6bf992d-d879-4b96-be5a-6a9a7dc76469 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.230844 May 20 09:19:24.408582 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 414/802] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:24 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:25.427037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:25.428241 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:25.436168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:25.436889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:25.437864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:25.438850 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:25.601660 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:25.610379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:25.611948 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:25.613114 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-25bdddb0-2aa7-4249-a2ae-b3df9f2dbc77 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.190928 May 20 09:19:25.613667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 389/803] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:25 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:19:26.633895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:26.634461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:26.641738 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:26.642176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:26.643284 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:26.643749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:26.825550 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:26.839785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:26.841446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:26.842746 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-380cf041-fcde-4bc8-a285-6d44df3307f1 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1737 microversion: 2.20 time: 0.213157 May 20 09:19:26.843790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 415/804] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:26 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:27.865546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:27.866643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:27.875543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:27.875986 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:27.876757 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:27.877158 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:28.019364 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:28.027574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:28.029050 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:28.030321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bd8cc92b-23d1-440c-b70e-ad1861d7362d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1719 microversion: 2.20 time: 0.171310 May 20 09:19:28.030823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 390/805] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:27 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:29.048976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:29.049477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:29.056400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:29.056933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:29.057718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:29.058140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:29.207843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:29.215890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:29.217438 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:29.218609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-70017759-3991-45ab-bf08-a638b39bb067 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1719 microversion: 2.20 time: 0.173967 May 20 09:19:29.219174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 416/806] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:29 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:30.236341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:30.236959 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:30.239229 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=28 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:30.244611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:30.245049 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:30.245799 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:30.246220 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:30.385344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:30.393930 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:30.395465 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:30.396634 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c0ad55bc-4b32-43cb-af39-60a937a8596a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1722 microversion: 2.20 time: 0.164257 May 20 09:19:30.397228 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 391/807] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:30 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:30.414501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a7c6498-cff5-4e28-b916-e69f00d80a5c"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:30.415629 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:30.422288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:30.422789 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:30.423773 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:30.424209 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:30.723172 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6f5eabe0-aec3-4b97-907f-5894cf6b7312 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312636 May 20 09:19:30.724075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 417/808] 10.222.0.69 () {62 vars in 1363 bytes} [Fri May 20 09:19:30 2022] POST /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 20 09:19:30.844265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:30.844872 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:30.851180 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:30.851666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:30.852422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:30.852845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:31.090631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2d960934-5cf8-4c06-8e83-dd4082c5a36e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-volume_attachments/4a7c6498-cff5-4e28-b916-e69f00d80a5c" status: 202 len: 0 microversion: 2.20 time: 0.251347 May 20 09:19:31.091346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 392/809] 10.222.0.69 () {60 vars in 1456 bytes} [Fri May 20 09:19:30 2022] DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-volume_attachments/4a7c6498-cff5-4e28-b916-e69f00d80a5c => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 20 09:19:31.149767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:31.150338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:31.157423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:31.157877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:31.158652 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:31.159088 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:31.248104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f599f7bb-95f4-4464-bad6-d8e44922a7f4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "POST /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/action" status: 202 len: 0 microversion: 2.20 time: 0.102536 May 20 09:19:31.248985 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 418/810] 10.222.0.69 () {62 vars in 1318 bytes} [Fri May 20 09:19:31 2022] POST /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 20 09:19:31.257210 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:31.258371 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:31.265839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:31.266289 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:31.267054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:31.267903 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:31.402548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:31.410613 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:31.412129 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:31.413291 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-95a4dff1-f750-4d3f-bce2-5ad0cc11ea6d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1670 microversion: 2.20 time: 0.160083 May 20 09:19:31.413854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 393/811] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:31 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:31.538909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-37a58887-8b8b-41d7-ba61-5c5576b05501 req-56352185-e7fb-4e28-875f-71568f8b7cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "name": "network-vif-unplugged", "status": "completed", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:31.548461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-37a58887-8b8b-41d7-ba61-5c5576b05501 req-56352185-e7fb-4e28-875f-71568f8b7cec service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:31.549458 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-37a58887-8b8b-41d7-ba61-5c5576b05501 req-56352185-e7fb-4e28-875f-71568f8b7cec service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:31.561625 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.compute.server_external_events [req-37a58887-8b8b-41d7-ba61-5c5576b05501 req-56352185-e7fb-4e28-875f-71568f8b7cec service nova] Unable to find a host for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8. Dropping event network-vif-unplugged {{(pid=117980) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 20 09:19:31.562594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-37a58887-8b8b-41d7-ba61-5c5576b05501 req-56352185-e7fb-4e28-875f-71568f8b7cec service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028122 May 20 09:19:31.563497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 419/812] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 20 09:19:32.433697 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:32.434305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:32.442578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:32.443020 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:32.443843 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:32.444263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:32.578505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:32.587005 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:32.588557 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:32.589716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f804ebf1-87f2-450f-9fd4-ef89ee08878c tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.160930 May 20 09:19:32.590286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 394/813] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:32 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:33.615975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:33.618964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:33.627750 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:33.628638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:33.629532 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:33.630023 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:33.656245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:33.788699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:33.797664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:33.799909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:33.801319 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a33f33df-8e18-40be-8686-1d3a53ead3a4 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.195904 May 20 09:19:33.801883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 420/814] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:33 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:19:34.819891 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:34.820622 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:34.828375 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:34.828827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:34.829600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:34.830032 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:35.004647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:35.015393 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:35.017014 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:35.019054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-57ea8ab5-7c26-49b0-934f-248f1abf7acf tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.203781 May 20 09:19:35.030709 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 395/815] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:34 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:36.038531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:36.039201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:36.053420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:36.053843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:36.054616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:36.055148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:36.220947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:36.230191 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:36.231802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:36.233199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fd3ff851-3f93-446e-8493-1321173e6527 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.199126 May 20 09:19:36.233749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 421/816] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:36 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:37.259932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:37.260573 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:37.281442 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:37.282219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:37.283166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:37.283642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:37.615992 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:37.624749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:37.626521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:37.627900 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-09233aa2-2d3d-495b-be9b-e21af598d79b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.379072 May 20 09:19:37.628561 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 396/817] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:37 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:38.282900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:38.283693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:38.291569 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:38.292322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:38.293563 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:38.294380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:38.322657 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:19:38.412307 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7b7e1c99-d3f4-4c3b-abab-97bd38dcec01 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "DELETE /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 204 len: 0 microversion: 2.1 time: 0.133075 May 20 09:19:38.412898 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 422/818] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:19:38 2022] DELETE /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:19:38.421332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:38.421944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:38.428717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:38.431332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:38.431332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:38.431332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:38.583833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:38.592109 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bfd58788-2f16-401b-b59f-5322eeb9987c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1575 microversion: 2.1 time: 0.174676 May 20 09:19:38.592715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 397/819] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:38 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:38.646997 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:38.647732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:38.653791 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:38.654220 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:38.654998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:38.655457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:38.804040 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:38.812437 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:38.814135 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:38.815474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a55ac7a0-b8f9-41bc-b6a5-39d4ff454049 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.173139 May 20 09:19:38.816308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 423/820] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:38 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:39.038038 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:39.039294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:39.046836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:39.047860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:39.048659 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:39.049112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:39.075042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-adbd1060-f478-4e45-b84d-24e1c9b4a0f2 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/ips" status: 200 len: 149 microversion: 2.1 time: 0.041675 May 20 09:19:39.083378 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 398/821] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:19:39 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:39.610080 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:39.611701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:39.621549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:39.622965 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:39.624145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:39.624826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:39.837674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:39.838982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:39.846612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:39.854935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8c2961c5-1876-4261-99d7-34f728e3c9ae tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1575 microversion: 2.1 time: 0.248744 May 20 09:19:39.858211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 424/822] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:39 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:39.860527 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:39.860971 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:39.861788 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:39.862375 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:40.029007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:40.037445 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:40.039428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:40.040901 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ce10a3e1-430b-4477-9351-3b1175f8936f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.208307 May 20 09:19:40.052596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 399/823] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:39 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:40.597863 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f510382-a8d6-4df1-9f3f-3c66bbe94b90"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:40.598994 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:40.607674 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:40.609682 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:40.610862 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:40.612424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:40.877438 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:40.879687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:40.887786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:40.889006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:40.889856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:40.890291 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:41.121998 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:41.140083 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4a970a0e-313c-47b8-aed0-3e23cd4b1a5d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1575 microversion: 2.1 time: 0.268098 May 20 09:19:41.140809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 400/824] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:40 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:19:41.145460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:41.146069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:41.157332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:41.158374 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:41.159571 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:41.160257 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:41.313459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:41.323666 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:41.325448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:41.326887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0023bf5c-8b3a-47e0-b31e-137815e69ca9 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.185356 May 20 09:19:41.337438 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 401/825] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:41 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:41.792625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:41.793511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:41.802644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:41.803555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:41.804394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:41.805055 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:41.810339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:41.840972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fedb6f0d-9fd7-42a3-bbdc-9af5a697315f tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/ips" status: 200 len: 147 microversion: 2.1 time: 0.052363 May 20 09:19:41.841629 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 402/826] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:19:41 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/ips => generated 147 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:42.158520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:42.160877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:42.171224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:42.171948 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:42.203095 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:42.203886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:42.414733 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:42.423794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f5f5b816-f24a-4e00-a3e6-e5907e5fdf63 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1575 microversion: 2.1 time: 0.269801 May 20 09:19:42.424566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 403/827] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:42 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:19:42.439739 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:42.440457 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:42.446948 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:42.447508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:42.448535 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:42.449052 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:42.654329 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:42.663664 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:42.665070 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:42.666222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eba952f6-836c-4792-a974-b862b640a98e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.240394 May 20 09:19:42.666765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 404/828] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:42 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:43.225649 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1308865086", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "networks": [{"uuid": "7c4daf32-ed58-4d1f-a204-f678b6d4c5c3"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:43.278513 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] validate_networks() for [('7c4daf32-ed58-4d1f-a204-f678b6d4c5c3', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:19:43.661480 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:19:43.661899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:19:43.662365 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:19:43.662765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:19:43.663171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:19:43.672667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:43.673105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:43.673882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:43.674307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:43.691392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Getting quotas for project e619f7d90e8543ba85f3bbaba9046c72. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:19:43.695681 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Getting quotas for user 661271a657a548468ff85fe298e0c5f9 and project e619f7d90e8543ba85f3bbaba9046c72. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:19:43.707206 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:19:43.709483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:19:43.759383 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a24fc37a-4e1f-4bdf-a62a-400f88823bdc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537656 May 20 09:19:43.760022 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 405/829] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 20 09:19:43.768783 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99ecf1f2-7c73-4cc0-b668-124288533e44"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:43.770036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:43.777709 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:43.778407 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:43.779200 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:43.779932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.100622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cd00b98c-a2f4-4338-bc67-cf6a0cc0452d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "POST /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.506568 May 20 09:19:45.101595 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 425/830] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:19:40 2022] POST /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 194 bytes in 4508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:45.107026 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:45.108587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:45.116022 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:45.116701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.117961 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:45.118581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.171444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f414b98e-da34-4265-88ac-63e47f50186c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.404963 May 20 09:19:45.172828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 406/831] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:19:43 2022] POST /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments => generated 194 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:45.194371 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:45.196875 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:45.213006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:45.214435 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.215602 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:45.216222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.276824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:45.285388 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2601bb8f-12d7-44c8-8006-964def0836fa tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1575 microversion: 2.1 time: 0.182359 May 20 09:19:45.285978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 426/832] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:45 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:45.291480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:45.292087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:45.308192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:45.308932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.311146 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:45.313387 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:45.404309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:45.404456 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:45.412335 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-78c97c2e-9a03-4cf9-b663-053754ec008d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1271 microversion: 2.1 time: 0.124699 May 20 09:19:45.412988 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 427/833] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:45 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:45.413885 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:45.415625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:45.417035 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6c9b8d32-99d0-4d5a-a7dc-817fcde9ebde tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.242863 May 20 09:19:45.417800 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 407/834] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:45 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:46.303150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:46.304406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:46.311291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:46.311722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:46.312524 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:46.313680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:46.432018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:46.432991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:46.448231 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:46.449069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:46.450115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:46.450703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:46.658411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:46.667777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5c2864d3-136b-44a8-9d18-92f5bfa1b4bd tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1319 microversion: 2.1 time: 0.242067 May 20 09:19:46.677574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 408/835] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:46 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:19:46.682076 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:46.682946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:46.688924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:46.698792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:46.701682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:46.702744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:46.704468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-43f5dedc-ac3d-457a-b292-d57ef766fdde tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 200 len: 1508 microversion: 2.1 time: 0.406148 May 20 09:19:46.705285 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:46.706818 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 428/836] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:46 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:46.967906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:46.977112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:46.980919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:46.985725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ab711ed7-b825-4734-84d1-05330c6ff481 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.308718 May 20 09:19:46.988838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 409/837] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:46 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:47.084092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-146c259e-7ec3-4743-9615-bf3768a9e4df req-5065e7f2-9ce2-4c2f-b5d5-2f5508085794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724e6ca0-78af-4670-a409-d2ee15ebf3d4", "name": "network-vif-deleted", "tag": "9b807888-e022-4e95-89be-56a386f87d4b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:47.097614 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-146c259e-7ec3-4743-9615-bf3768a9e4df req-5065e7f2-9ce2-4c2f-b5d5-2f5508085794 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.098409 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-146c259e-7ec3-4743-9615-bf3768a9e4df req-5065e7f2-9ce2-4c2f-b5d5-2f5508085794 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.112168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-146c259e-7ec3-4743-9615-bf3768a9e4df req-5065e7f2-9ce2-4c2f-b5d5-2f5508085794 service nova] Creating event network-vif-deleted:9b807888-e022-4e95-89be-56a386f87d4b for instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 on hv-cinder-83699 May 20 09:19:47.120796 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-146c259e-7ec3-4743-9615-bf3768a9e4df req-5065e7f2-9ce2-4c2f-b5d5-2f5508085794 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217262 May 20 09:19:47.126389 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 429/838] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:19:47.429577 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-fc28ff23-3d23-4c5d-996f-103b6f48c798 req-36b2f620-d2b2-4219-ac89-cabeeb41dc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d658381-710d-4b21-b9e9-5661c178a89a", "tag": "c3e846d0-f6ed-4db9-8d76-e7c2a2fd731d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:47.440039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-fc28ff23-3d23-4c5d-996f-103b6f48c798 req-36b2f620-d2b2-4219-ac89-cabeeb41dc78 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.440668 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-fc28ff23-3d23-4c5d-996f-103b6f48c798 req-36b2f620-d2b2-4219-ac89-cabeeb41dc78 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.486561 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-fc28ff23-3d23-4c5d-996f-103b6f48c798 req-36b2f620-d2b2-4219-ac89-cabeeb41dc78 service nova] Creating event network-changed:c3e846d0-f6ed-4db9-8d76-e7c2a2fd731d for instance 1d658381-710d-4b21-b9e9-5661c178a89a on hv-cinder-83699 May 20 09:19:47.491982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-fc28ff23-3d23-4c5d-996f-103b6f48c798 req-36b2f620-d2b2-4219-ac89-cabeeb41dc78 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067327 May 20 09:19:47.497846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 410/839] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:47.690600 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:47.692252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:47.704390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.704390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.705160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.705603 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.723662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:47.724572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:47.733201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.733679 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.734819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.735555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.761864 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] HTTP exception thrown: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Request method failure captured: May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 HTTP/1.1 May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1xlNfTd5y71egibKMT4Wu7ryYA1WVl_SkXhkxfkL_0wzD4-xU9J6HHd1ThsatdPgbr-pqn32h67XUJKgQ4DYlc1GAHj1fm8DPa3rT5snA98qEP6UAs9NtGlyE-0EA3qTueFV6AbS_pxTGaarlhiuWhU7uWXcqWUUaOdLhrepJ84IaE May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:19:47.763778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f26ac8782fe0407cb6f146ba70e74246", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}] May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestVolumeBootPattern-297936034 May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestVolumeBootPattern-297936034-project May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bc0307909d614a1f97f006dc6d091cd4 May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestVolumeBootPattern-297936034-project May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:19:47.765806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '724e6ca0-78af-4670-a409-d2ee15ebf3d4'} May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:19:47.766927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:19:47.768837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:19:47.771042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Returning 404 to user: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:19:47.772388 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fddfd937-a3a1-4695-a4b4-cfbb81df963c tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 404 len: 111 microversion: 2.1 time: 0.053676 May 20 09:19:47.773511 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 411/840] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:47 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:19:47.779819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b8f0ef35-0ab8-4502-ac22-f1d29b0c4fef req-74158032-ab58-4049-8d11-28c9b524fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "name": "network-vif-plugged", "status": "completed", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:47.790908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b8f0ef35-0ab8-4502-ac22-f1d29b0c4fef req-74158032-ab58-4049-8d11-28c9b524fb6c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:47.791639 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b8f0ef35-0ab8-4502-ac22-f1d29b0c4fef req-74158032-ab58-4049-8d11-28c9b524fb6c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:47.804138 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b8f0ef35-0ab8-4502-ac22-f1d29b0c4fef req-74158032-ab58-4049-8d11-28c9b524fb6c service nova] Creating event network-vif-plugged:0fff114c-fe55-4714-bbdc-e879108b685e for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 on hv-cinder-83699 May 20 09:19:47.810085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b8f0ef35-0ab8-4502-ac22-f1d29b0c4fef req-74158032-ab58-4049-8d11-28c9b524fb6c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 May 20 09:19:47.811360 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 412/841] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:47.946808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:47.959292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1a3a70aa-0c9d-4670-8e37-ca3d5fd0f993 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1319 microversion: 2.1 time: 0.277069 May 20 09:19:47.961382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 430/842] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:47 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:47.993989 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836988343", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-276577009", "security_groups": [{"name": "tempest-secgroup-smoke-447532997"}], "block_device_mapping_v2": [{"uuid": "d8cc55b6-34aa-451c-b131-6827f8273d44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f48dba5-6c8f-4717-93d6-9f60508a64db"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:48.007489 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:48.008766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:48.017909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:48.018838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:48.020140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:48.020679 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:48.132214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] validate_networks() for [('5f48dba5-6c8f-4717-93d6-9f60508a64db', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:19:48.180088 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:48.189959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:48.191711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:48.192998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-23302e5b-5c26-4a7c-b9ed-9bf12ae0239a tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.191945 May 20 09:19:48.193568 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 431/843] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:47 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:48.512972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:19:48.513493 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:19:48.514036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:19:48.514575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:19:48.515007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:19:48.525094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:48.525544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:48.526343 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:48.526774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:48.544503 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for project f26ac8782fe0407cb6f146ba70e74246. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:19:48.548921 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for user bc0307909d614a1f97f006dc6d091cd4 and project f26ac8782fe0407cb6f146ba70e74246. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:19:48.608609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:19:48.610848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8cc55b6-34aa-451c-b131-6827f8273d44',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:19:48.750160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-309f4cee-c5c2-4e6d-af35-1e4c525941a4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761291 May 20 09:19:48.759846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 413/844] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:19:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:19:48.769244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1740a538-6939-442b-8b39-f87dc1052ed8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:48.772937 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1740a538-6939-442b-8b39-f87dc1052ed8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:48.839100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1740a538-6939-442b-8b39-f87dc1052ed8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:48.846181 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1740a538-6939-442b-8b39-f87dc1052ed8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1094 microversion: 2.1 time: 0.084673 May 20 09:19:48.847104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 432/845] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:48 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:48.977550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:48.978216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:48.984855 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:48.985296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:48.986093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:48.986451 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:49.194671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:49.203054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-57898489-9063-4082-a0fb-dbb5e725b1f0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1319 microversion: 2.1 time: 0.229571 May 20 09:19:49.203860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 414/846] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:48 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:49.216860 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:49.217761 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:49.224856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:49.225300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:49.226060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:49.226489 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:49.356955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:49.365529 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:49.367016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:49.368203 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7e629e97-e9ab-4c34-a47f-c88332543b0b tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.157230 May 20 09:19:49.368754 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 433/847] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:49 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:19:49.866966 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:49.867854 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:49.877523 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:49.878208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:49.879413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:49.880054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:49.946596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:49.956324 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e1150a2c-0474-48c4-b513-a97f23bcc708 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1192 microversion: 2.1 time: 0.094653 May 20 09:19:49.957232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 415/848] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:49 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:50.221222 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:50.221837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:50.229173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:50.229624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:50.230392 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:50.230829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:50.374901 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:50.384930 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0f114ef0-f890-4482-a7f1-cabe6d034d37 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1319 microversion: 2.1 time: 0.168191 May 20 09:19:50.385907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 434/849] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:50 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:50.387032 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:50.387684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:50.401056 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:50.401883 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:50.402927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:50.403631 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:50.620152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:50.628988 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:50.630698 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:50.632176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9421b752-4658-4520-873f-06a34364d1cb tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1728 microversion: 2.20 time: 0.250074 May 20 09:19:50.632821 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 416/850] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:50 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1728 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:19:50.974378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:50.974978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:50.981149 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:50.981593 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:50.982338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:50.982777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:51.053507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:51.057049 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:51.061809 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4aa6a63b-68a0-40b8-8601-42c0900663e6 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1210 microversion: 2.1 time: 0.091721 May 20 09:19:51.062728 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 435/851] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:50 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:51.402115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:51.402688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:51.409779 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:51.410232 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:51.411035 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:51.411505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:51.641692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:51.650048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:51.650684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:51.662105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-02ff80dc-238a-4715-b0ce-37886a2b0d63 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1319 microversion: 2.1 time: 0.263932 May 20 09:19:51.664516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:51.665161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:51.665544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 417/852] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:51 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:51.666485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:51.667061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:51.814429 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-91104076-a41f-4009-9d33-147e3768c334 req-d38468bb-e173-4e64-a443-7044e9a21095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d658381-710d-4b21-b9e9-5661c178a89a", "name": "network-vif-plugged", "status": "completed", "tag": "c3e846d0-f6ed-4db9-8d76-e7c2a2fd731d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:51.832733 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-91104076-a41f-4009-9d33-147e3768c334 req-d38468bb-e173-4e64-a443-7044e9a21095 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:51.833550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-91104076-a41f-4009-9d33-147e3768c334 req-d38468bb-e173-4e64-a443-7044e9a21095 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:51.852249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:51.855137 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-91104076-a41f-4009-9d33-147e3768c334 req-d38468bb-e173-4e64-a443-7044e9a21095 service nova] Creating event network-vif-plugged:c3e846d0-f6ed-4db9-8d76-e7c2a2fd731d for instance 1d658381-710d-4b21-b9e9-5661c178a89a on hv-cinder-83699 May 20 09:19:51.860472 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-91104076-a41f-4009-9d33-147e3768c334 req-d38468bb-e173-4e64-a443-7044e9a21095 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052081 May 20 09:19:51.861213 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 418/853] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:19:51.865549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:51.868693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:51.871759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-db801bb9-b1d3-421a-86f9-14a23a5587ea tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1715 microversion: 2.20 time: 0.225493 May 20 09:19:51.888158 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 436/854] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:19:51 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1715 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 20 09:19:52.076246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:52.077146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:52.079435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:52.080044 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:52.083118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:52.085500 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.086423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.087572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.088310 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.089161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.089590 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.090359 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.093080 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.194831 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lazy-loading 'services' on Instance uuid a803a923-432b-49f2-8495-8db38c6e44e1 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:19:52.254182 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:52.262121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5dfa495d-ee6d-4c30-8dc7-cbcbb13fed9d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1277 microversion: 2.1 time: 0.186618 May 20 09:19:52.262917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 437/855] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:52 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:52.326091 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-feaadbfd-7312-44ae-899a-0b41b9eae464 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments/5f510382-a8d6-4df1-9f3f-3c66bbe94b90" status: 202 len: 0 microversion: 2.1 time: 0.253811 May 20 09:19:52.326757 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 419/856] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:19:52 2022] DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments/5f510382-a8d6-4df1-9f3f-3c66bbe94b90 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:19:52.335201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:52.337339 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:52.345558 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.346154 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.346947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.347423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.389102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c6d6e389-038c-4aa6-a446-301cc4f5ab14 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056902 May 20 09:19:52.389980 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 438/857] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:52 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:19:52.514873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b9aadf53-ce14-4c88-994e-9a475d8a6db4 req-21edc590-bf13-4863-8add-9adf96dd08f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18f53dc-1246-48a4-89c6-0872683b41a6", "tag": "b5598616-768d-4048-8257-a24495be6820"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:52.527372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b9aadf53-ce14-4c88-994e-9a475d8a6db4 req-21edc590-bf13-4863-8add-9adf96dd08f4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.527820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b9aadf53-ce14-4c88-994e-9a475d8a6db4 req-21edc590-bf13-4863-8add-9adf96dd08f4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.544515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b9aadf53-ce14-4c88-994e-9a475d8a6db4 req-21edc590-bf13-4863-8add-9adf96dd08f4 service nova] Creating event network-changed:b5598616-768d-4048-8257-a24495be6820 for instance f18f53dc-1246-48a4-89c6-0872683b41a6 on hv-cinder-83699 May 20 09:19:52.550248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b9aadf53-ce14-4c88-994e-9a475d8a6db4 req-21edc590-bf13-4863-8add-9adf96dd08f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039281 May 20 09:19:52.551021 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 420/858] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:52.678313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:52.678928 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:52.685767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.686238 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.687003 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:52.687478 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:52.836099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:52.843633 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9cea60d9-e545-4733-aacc-47c7ff2c5c16 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1319 microversion: 2.1 time: 0.169221 May 20 09:19:52.844204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 439/859] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:52 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:53.285040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:53.286184 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:53.296872 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:53.297618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:53.298874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:53.299646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:53.402235 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:53.403206 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:53.409992 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:53.410444 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:53.411198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:53.411661 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:53.440851 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6500d9f6-4637-4e92-9545-898a3b0f2470 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042594 May 20 09:19:53.441464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 440/860] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:53 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:53.441719 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:53.444046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:53.451123 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a19d81a0-6b11-405f-a52e-260200c4eb51 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1277 microversion: 2.1 time: 0.173382 May 20 09:19:53.451695 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 421/861] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:53 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:53.861298 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:53.861933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:53.868560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:53.869001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:53.869749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:53.870141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:54.012402 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:54.020463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-78d1e151-8939-4c9e-abba-769669e0e398 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1508 microversion: 2.1 time: 0.163431 May 20 09:19:54.021038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 441/862] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:53 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:54.453107 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:54.453107 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:54.461146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:54.461596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:54.462371 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:54.462808 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:54.470710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:54.471383 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:54.478097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:54.478622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:54.479747 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:54.480184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:54.494544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-beb14bfa-c1e3-4397-bb74-2274cc10b0bf tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 May 20 09:19:54.495101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 422/863] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:54 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:54.614605 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:54.622406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dfa7381d-b1be-4018-9af7-269ec9d03668 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1277 microversion: 2.1 time: 0.157638 May 20 09:19:54.623037 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 442/864] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:54 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:55.506397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:55.507317 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:55.514225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:55.514662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:55.515460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:55.515888 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:55.549621 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3289abcc-cc13-49a7-8bcd-238ec6794afd tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 May 20 09:19:55.550188 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 423/865] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:55 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:55.644691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:55.645619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:55.656422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:55.656871 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:55.657631 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:55.658092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:55.798596 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:55.806526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2c31e0e9-ede6-4106-917b-9cb3438362bf tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1277 microversion: 2.1 time: 0.168783 May 20 09:19:55.807107 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 443/866] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:55 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:56.561624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:56.562568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:56.569308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:56.569756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:56.570523 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:56.570980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:56.600754 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-35d0119d-7813-42ad-a2fe-ef4376317e2d tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 May 20 09:19:56.601310 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 424/867] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:56 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:56.824034 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:56.824624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:56.832525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:56.832978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:56.833746 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:56.834177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:56.973696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:56.982333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dac4a7be-e898-4ade-b9a7-da722ca0c6b0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1277 microversion: 2.1 time: 0.162190 May 20 09:19:56.982935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 444/868] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:56 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:57.611791 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:57.612703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:57.619633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:57.620071 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:57.620827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:57.621328 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:57.652901 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cf45eeef-e075-4d50-9730-1a91d0e8dc31 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 May 20 09:19:57.653449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 425/869] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:57 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:58.002693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:58.003227 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:58.010173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.010645 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.011522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.011954 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.154506 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:58.162316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-309c5ece-a516-4e8e-a989-cafde46d8c1e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1277 microversion: 2.1 time: 0.165981 May 20 09:19:58.162877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 445/870] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:57 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:19:58.304157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:58.305089 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:58.306971 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:58.312515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.312962 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.313764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.314211 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.343441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2270bb87-1156-46b3-a18c-07a1dcb8880e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043326 May 20 09:19:58.344052 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 426/871] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:58 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:58.354309 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:58.354964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:58.362144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.362766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.363664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.364048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.395444 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fe9d1d5b-d90f-4cfa-91c2-23b84708bcae tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/99ecf1f2-7c73-4cc0-b668-124288533e44" status: 200 len: 194 microversion: 2.1 time: 0.045133 May 20 09:19:58.396047 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 446/872] 10.222.0.69 () {58 vars in 1412 bytes} [Fri May 20 09:19:58 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/99ecf1f2-7c73-4cc0-b668-124288533e44 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:58.661939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:58.663179 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=12 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:58.671823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:58.673109 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:58.681754 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.682205 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.682985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:58.683465 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:58.721175 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dcf3ae54-8fb8-4ac2-8927-7dcbabeebd5f tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060225 May 20 09:19:58.721814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 427/873] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:58 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:19:59.179869 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:59.180464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:59.182383 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:19:59.188379 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.188853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.189606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.190043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.324732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:19:59.332975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a337e28b-7a76-41ab-8de8-196a7386da9e tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.157182 May 20 09:19:59.333549 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 447/874] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:59 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:19:59.733396 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:59.734349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:59.741517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.741800 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.742577 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.742984 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.757376 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a66d4041-bc1c-4b2e-b878-deb11fb4bed7"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:19:59.758466 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:59.764636 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.765083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.765846 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.766274 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.777390 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-049b7f8a-f850-4c99-96f6-ac00c9932568 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048200 May 20 09:19:59.778248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 428/875] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:19:59 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:19:59.841010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:59.841645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:59.847614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.849523 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.850312 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.850826 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.876214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:19:59.968124 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9a9928fc-e549-4bf3-abb6-6e0a97343b4e tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 204 len: 0 microversion: 2.1 time: 0.130590 May 20 09:19:59.970454 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 429/876] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:19:59 2022] DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 20 09:19:59.979963 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:19:59.980750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:19:59.987043 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.987516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:19:59.988306 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:19:59.988732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:00.038710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-eeba0099-4c4c-4738-ae4e-e337247bdd96 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "POST /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285119 May 20 09:20:00.039355 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 448/877] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:19:59 2022] POST /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:00.132733 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:00.140599 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7d0f6ddf-3f4a-4dcc-9cf0-582bd36546d4 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1680 microversion: 2.1 time: 0.165239 May 20 09:20:00.141258 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 430/878] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:19:59 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:20:00.351463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:00.352016 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:00.359141 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:00.359632 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:00.360390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:00.360825 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:00.507336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:00.515612 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7ca8881d-fdb0-4390-b8ce-1db061c60141 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.169071 May 20 09:20:00.516182 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 449/879] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:00 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:01.158525 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:01.159149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:01.167768 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:01.168221 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:01.168981 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:01.169421 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:01.304822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:01.312857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-84ba961d-2549-4951-a47f-676ea2a6f46c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1680 microversion: 2.1 time: 0.158610 May 20 09:20:01.313436 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 431/880] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:01 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:01.532992 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:01.533593 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:01.540331 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:01.540757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:01.541494 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:01.541922 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:01.683911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:01.691673 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1a8b2ce1-3e68-4151-a787-a279fcd84e9a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.162565 May 20 09:20:01.692337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 450/881] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:01 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:02.330342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:02.330939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:02.338065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:02.338704 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:02.339697 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:02.341051 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:02.415598 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff944e4cf29b4297acc63b591d90daaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddfd22e3dde4cc89c073bd2d88d648b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:02.424605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-08f00a59-6a45-4eab-b834-fa0892b03e78 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 200 len: 1612 microversion: 2.1 time: 0.098235 May 20 09:20:02.425166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 432/882] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:02 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 1612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:02.641001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-17511086-d76a-46b4-ab78-638fc1178958 req-8d762559-12fc-4bc6-ad50-fafd14757cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a803a923-432b-49f2-8495-8db38c6e44e1", "name": "network-vif-deleted", "tag": "449fbc31-4c62-4d87-bf2d-b96937911200"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:02.651713 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-17511086-d76a-46b4-ab78-638fc1178958 req-8d762559-12fc-4bc6-ad50-fafd14757cf2 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:02.652249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-17511086-d76a-46b4-ab78-638fc1178958 req-8d762559-12fc-4bc6-ad50-fafd14757cf2 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:02.674498 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:02.677642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-17511086-d76a-46b4-ab78-638fc1178958 req-8d762559-12fc-4bc6-ad50-fafd14757cf2 service nova] Creating event network-vif-deleted:449fbc31-4c62-4d87-bf2d-b96937911200 for instance a803a923-432b-49f2-8495-8db38c6e44e1 on hv-cinder-83699 May 20 09:20:02.683184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-17511086-d76a-46b4-ab78-638fc1178958 req-8d762559-12fc-4bc6-ad50-fafd14757cf2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046247 May 20 09:20:02.684211 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 451/883] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:02.708681 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:02.709265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:02.717357 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:02.718125 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:02.719116 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:02.719805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:02.898728 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:02.908397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d3e42d3e-dbfa-432c-be9b-5fea8a9f760d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.203485 May 20 09:20:02.911586 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 433/884] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:02 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:03.442779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:03.443607 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:03.450630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:03.451160 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:03.452019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:03.452521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:03.471175 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 HTTP/1.1 May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:03.472946 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:03.474638 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'a803a923-432b-49f2-8495-8db38c6e44e1'} May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:03.475551 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:03.477073 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:03.478384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:03.478384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9b367252-74f4-41d2-8e84-d540e6c58e25 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 404 len: 111 microversion: 2.1 time: 0.035968 May 20 09:20:03.478384 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 452/885] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:03 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:03.483541 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a3ce400a-227b-4bc7-952f-209e658bccc7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '.version_select at 0x7f7c90832c10>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:03.502983 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a3ce400a-227b-4bc7-952f-209e658bccc7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982750132" status: 202 len: 0 microversion: 2.1 time: 0.023311 May 20 09:20:03.503601 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 434/886] 10.222.0.69 () {58 vars in 1217 bytes} [Fri May 20 09:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982750132 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:20:03.926526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:03.927424 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:03.934262 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:03.934692 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:03.935687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:03.936116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:04.081567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:04.091069 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-13a23608-ecf5-4d4f-9e9b-2a8f0c812123 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.167378 May 20 09:20:04.091710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 453/887] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:03 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:05.113283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:05.114224 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:05.126288 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:05.127033 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:05.128280 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:05.129008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:05.281037 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:05.285254 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:05.285752 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:05.289247 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-65aeebc7-9dd7-4722-98e7-e159fc218c8a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.183480 May 20 09:20:05.289858 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 435/888] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:05 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:05.292290 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:05.292739 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:05.293496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:05.293925 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:05.307321 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 HTTP/1.1 May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:05.308892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.310385 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'a803a923-432b-49f2-8495-8db38c6e44e1'} May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:05.314200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.315762 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:05.317237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:05.317237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8630c419-c41a-44bd-aea8-8d32aeede045 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 404 len: 111 microversion: 2.1 time: 0.028843 May 20 09:20:05.317237 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 454/889] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:05 2022] DELETE /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:05.318896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:05.319582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: a803a923-432b-49f2-8495-8db38c6e44e1] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:05.325717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:05.326157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:05.326903 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:05.327381 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:05.345928 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 HTTP/1.1 May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:05.347646 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.349185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'a803a923-432b-49f2-8495-8db38c6e44e1'} May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:05.350068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. May 20 09:20:05.351521 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:05.352765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance a803a923-432b-49f2-8495-8db38c6e44e1 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:05.352765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0ba39b26-9f61-4714-ace3-4aad5d45b034 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1" status: 404 len: 111 microversion: 2.1 time: 0.034182 May 20 09:20:05.352765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 436/890] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:05 2022] GET /compute/v2.1/servers/a803a923-432b-49f2-8495-8db38c6e44e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:20:06.306399 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:06.307011 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:06.313890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.314330 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.315086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.315570 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.451451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:06.461619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-47d948a3-cefb-4cf7-9a4a-d08ca8f99d8d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.159333 May 20 09:20:06.462230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 455/891] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:06 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:06.486132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:06.486624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:06.493246 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.493706 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.494451 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.494866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.508512 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 HTTP/1.1 May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:06.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.514837 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '03e1e109-bd6a-4764-b404-03e02b059042'} May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:06.515927 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.517677 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.519082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:06.519082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1cddb8c0-c92d-4a6a-a56b-21e2634242e7 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 404 len: 111 microversion: 2.1 time: 0.029104 May 20 09:20:06.519082 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 437/892] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:06 2022] DELETE /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:06.520773 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:06.521153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 03e1e109-bd6a-4764-b404-03e02b059042] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:06.527976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.528423 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.529177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.529604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.543635 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 HTTP/1.1 May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:06.545171 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.546643 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '03e1e109-bd6a-4764-b404-03e02b059042'} May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:06.547468 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. May 20 09:20:06.548973 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.550028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance 03e1e109-bd6a-4764-b404-03e02b059042 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:06.550028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ec742353-eeab-4a56-ae00-c9f468d8e41c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042" status: 404 len: 111 microversion: 2.1 time: 0.031317 May 20 09:20:06.550028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 456/893] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:06 2022] GET /compute/v2.1/servers/03e1e109-bd6a-4764-b404-03e02b059042 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:06.558534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:06.559173 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:06.568723 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.569430 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.570389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.570819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.584587 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 HTTP/1.1 May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:06.586145 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.587630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'cd40b569-94f7-46ca-9c6e-9fce603f84a6'} May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:06.588520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.589822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:06.591040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:06.591040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0468e7fe-f56b-4d41-99ab-07cb4ae37fa5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 404 len: 111 microversion: 2.1 time: 0.035241 May 20 09:20:06.591040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 438/894] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:06 2022] DELETE /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:06.596167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:06.596781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: cd40b569-94f7-46ca-9c6e-9fce603f84a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:06.603021 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.603516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.604259 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:06.604685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:06.618283 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 HTTP/1.1 May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:06.619806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.621436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'cd40b569-94f7-46ca-9c6e-9fce603f84a6'} May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:06.622208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. May 20 09:20:06.623448 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:06.624592 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance cd40b569-94f7-46ca-9c6e-9fce603f84a6 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:06.624592 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c8e976e9-38b9-4731-bfab-9518b42ff0c5 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6" status: 404 len: 111 microversion: 2.1 time: 0.028857 May 20 09:20:06.624592 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 457/895] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:06 2022] GET /compute/v2.1/servers/cd40b569-94f7-46ca-9c6e-9fce603f84a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:07.478122 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:07.478740 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:07.487093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.487680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.488653 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.489294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.623611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:07.626317 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:07.633312 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4367c1ba-94b9-4143-ab3d-49f0c47a0857 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.159094 May 20 09:20:07.633920 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 439/896] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:07 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:07.763732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:07.764314 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:07.772114 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.772567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.773403 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.773845 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.784969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-47a13dcd-2310-4c61-93db-9eee98e98a23 req-7cffc9b2-b255-4e50-9cb7-d3330c2b85e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18f53dc-1246-48a4-89c6-0872683b41a6", "name": "network-vif-plugged", "status": "completed", "tag": "b5598616-768d-4048-8257-a24495be6820"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:07.788490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 HTTP/1.1 May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:07.790086 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.791584 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '121038e6-7ba5-4d8f-b099-53e27cc913c6'} May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:07.795578 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.797121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.798449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:07.798449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5f381802-4d51-440a-888f-0876919265c9 tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 404 len: 111 microversion: 2.1 time: 0.031931 May 20 09:20:07.798449 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 458/897] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:07 2022] DELETE /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:07.798678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-47a13dcd-2310-4c61-93db-9eee98e98a23 req-7cffc9b2-b255-4e50-9cb7-d3330c2b85e5 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.798678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-47a13dcd-2310-4c61-93db-9eee98e98a23 req-7cffc9b2-b255-4e50-9cb7-d3330c2b85e5 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.800555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:07.801282 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] [instance: 121038e6-7ba5-4d8f-b099-53e27cc913c6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:07.807794 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.808244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.809066 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:07.809498 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:07.810811 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-47a13dcd-2310-4c61-93db-9eee98e98a23 req-7cffc9b2-b255-4e50-9cb7-d3330c2b85e5 service nova] Creating event network-vif-plugged:b5598616-768d-4048-8257-a24495be6820 for instance f18f53dc-1246-48a4-89c6-0872683b41a6 on hv-cinder-83699 May 20 09:20:07.816121 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-47a13dcd-2310-4c61-93db-9eee98e98a23 req-7cffc9b2-b255-4e50-9cb7-d3330c2b85e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 May 20 09:20:07.816881 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 440/898] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:07.824198 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] HTTP exception thrown: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Request method failure captured: May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 HTTP/1.1 May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBimqqjjnIlOYqABx9mukQb3rMeiy0JAt2VHTPWFI2589RRkBZOFMVhgbB8A9kj3MTdg2RDIEj5FxrwlexafCC5ajOjauuZLm8Nx49KoBDj1lhCVZfbGf41IqMXgzAHmVJT463CgcMBfF1z93-9wanKlRy_1rjB_iT_5RRU741z3g May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:07.825748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2ddfd22e3dde4cc89c073bd2d88d648b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2ddfd22e3dde4cc89c073bd2d88d648b"}]}] May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 2ddfd22e3dde4cc89c073bd2d88d648b May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-981238130 May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: ff944e4cf29b4297acc63b591d90daaf May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-981238130-project May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.827315 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '121038e6-7ba5-4d8f-b099-53e27cc913c6'} May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:07.828245 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. May 20 09:20:07.829659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:07.830961 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] Returning 404 to user: Instance 121038e6-7ba5-4d8f-b099-53e27cc913c6 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:07.830961 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7cb1de22-2860-4344-a27f-c714b5b3c11c tempest-AttachVolumeNegativeTest-981238130 tempest-AttachVolumeNegativeTest-981238130-project] 10.222.0.69 "GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6" status: 404 len: 111 microversion: 2.1 time: 0.030866 May 20 09:20:07.830961 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 459/899] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:07 2022] GET /compute/v2.1/servers/121038e6-7ba5-4d8f-b099-53e27cc913c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:08.635019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:08.636432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:08.643967 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.644406 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.645261 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.645692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.650328 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:08.651040 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:08.657594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.658124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.658962 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.659576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.681459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-20addd48-0424-47a8-ae2d-65b07679c345 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051157 May 20 09:20:08.686806 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 441/900] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:20:08 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:08.797352 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:08.798298 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:08.799927 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:08.804793 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.805243 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.806171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.806611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.809680 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8e9b53d4-f2e5-4c42-935a-af7c481b92e1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.163240 May 20 09:20:08.810811 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 460/901] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:08 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:08.840013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d0600450-95f1-4354-b072-4836950b46a5 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/99ecf1f2-7c73-4cc0-b668-124288533e44" status: 200 len: 194 microversion: 2.1 time: 0.047708 May 20 09:20:08.840569 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 442/902] 10.222.0.69 () {58 vars in 1412 bytes} [Fri May 20 09:20:08 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/99ecf1f2-7c73-4cc0-b668-124288533e44 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:08.850415 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:08.850938 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:08.857250 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.857692 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.858446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:08.858878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:08.941140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lazy-loading 'services' on Instance uuid 1a725791-6ff4-480f-8bce-77731edd3aad {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:20:09.019718 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-411d6826-2174-446c-bf24-f79cec384d6e tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/99ecf1f2-7c73-4cc0-b668-124288533e44" status: 202 len: 0 microversion: 2.1 time: 0.173038 May 20 09:20:09.020377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 461/903] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:20:08 2022] DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/99ecf1f2-7c73-4cc0-b668-124288533e44 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 20 09:20:09.826578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:09.827148 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:09.833831 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:09.834278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:09.835046 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:09.835781 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:10.049574 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:10.057882 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0dad3287-ed1e-4df7-b6a3-fe70101f1c20 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1265 microversion: 2.1 time: 0.235721 May 20 09:20:10.058832 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 443/904] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:09 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:10.305125 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2abcf09f-85cf-480f-bdcd-17afcda327f7", "device": "/dev/sdb"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:10.306875 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:10.313445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:10.313885 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:10.314611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:10.315035 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.076717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:11.078976 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a0e6bbe7-cefc-4faf-9932-731ea206ed26 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "POST /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779861 May 20 09:20:11.079559 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:11.086304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 462/905] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:20:10 2022] POST /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:11.093092 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.093541 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.094320 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.094750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.223734 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:11.224585 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:11.237464 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.237822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.241909 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.242555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.286852 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f1579119-5264-4126-861b-05b18c1a6d37 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/a66d4041-bc1c-4b2e-b878-deb11fb4bed7" status: 200 len: 194 microversion: 2.1 time: 0.067519 May 20 09:20:11.287514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 463/906] 10.222.0.69 () {58 vars in 1412 bytes} [Fri May 20 09:20:11 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/a66d4041-bc1c-4b2e-b878-deb11fb4bed7 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:11.301487 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:11.302148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:11.309406 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.311477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.312560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.313543 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.385038 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:11.394975 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6e0b041d-ef73-4013-a9bc-4beeb5b78d1b tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1453 microversion: 2.1 time: 0.323010 May 20 09:20:11.414592 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 444/907] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:11 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1453 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:11.420008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:11.429192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lazy-loading 'services' on Instance uuid 1a725791-6ff4-480f-8bce-77731edd3aad {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:20:11.432058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:11.450878 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.451351 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.452125 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:11.452555 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:11.533525 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ba8681dc-06d4-4f05-b170-b9dfac63c3e9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/a66d4041-bc1c-4b2e-b878-deb11fb4bed7" status: 202 len: 0 microversion: 2.1 time: 0.237019 May 20 09:20:11.534230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 464/908] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:20:11 2022] DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments/a66d4041-bc1c-4b2e-b878-deb11fb4bed7 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:20:11.687937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:11.695859 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4a199a88-73ff-4cf4-b72d-97a0b1860ade tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1453 microversion: 2.1 time: 0.279856 May 20 09:20:11.707275 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 445/909] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:11 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1453 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:12.860087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21b5734e-c636-4b8f-ae5d-2b3ff524b123 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Action: 'create', calling method: .version_select at 0x7f7c86e098b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-442856829", "metadata": {"Type": "work"}}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21b5734e-c636-4b8f-ae5d-2b3ff524b123 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Request method failure captured: May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 121 May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih11M4GGjs8VQhnQRJ6PHJ-086Eyhi2nlSJMPB-6IBKk6HfFQmA7y7gevqDobyK62rcGv1CkN9SGu0T93wywcguIsRuCRI-dZfarb66Ugh2hdUWAcB4p-WvE4hvAChpZDrXWg5-zrbdVSp28_UCgVUKj74fX7orOH5u1d42xl-2efqFc May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:12.870581 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f730af25ff034a338304e09f55a9f596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f730af25ff034a338304e09f55a9f596", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}] May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: eea7c4e3e9844a3eb6e7508d9016f52b May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-442856829", "metadata": {"Type": "work"}}} May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:20:12.872176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-442856829', 'metadata': {'Type': 'work'}}}} May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise error May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi On instance['volume']: May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi '#$%' May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:12.873170 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 20 09:20:12.875072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 20 09:20:12.876296 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 20 09:20:12.876296 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.876296 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21b5734e-c636-4b8f-ae5d-2b3ff524b123 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:12.876296 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-21b5734e-c636-4b8f-ae5d-2b3ff524b123 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132741 May 20 09:20:12.878063 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 465/910] 10.222.0.69 () {60 vars in 1155 bytes} [Fri May 20 09:20:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:12.882870 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-08d85b0b-a0ee-40ef-88d8-5ccc7b89afa3 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Action: 'create', calling method: .version_select at 0x7f7c90876700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1369680118", "metadata": {"Type": "work"}}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-08d85b0b-a0ee-40ef-88d8-5ccc7b89afa3 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Request method failure captured: May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 120 May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih11M4GGjs8VQhnQRJ6PHJ-086Eyhi2nlSJMPB-6IBKk6HfFQmA7y7gevqDobyK62rcGv1CkN9SGu0T93wywcguIsRuCRI-dZfarb66Ugh2hdUWAcB4p-WvE4hvAChpZDrXWg5-zrbdVSp28_UCgVUKj74fX7orOH5u1d42xl-2efqFc May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:12.886296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f730af25ff034a338304e09f55a9f596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f730af25ff034a338304e09f55a9f596", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}] May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: eea7c4e3e9844a3eb6e7508d9016f52b May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1369680118", "metadata": {"Type": "work"}}} May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: May 20 09:20:12.887982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1369680118', 'metadata': {'Type': 'work'}}}} May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise error May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi On instance['volume']: May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi '0' May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:12.889025 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 20 09:20:12.890446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 20 09:20:12.891937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 20 09:20:12.891937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.891937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-08d85b0b-a0ee-40ef-88d8-5ccc7b89afa3 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:12.891937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-08d85b0b-a0ee-40ef-88d8-5ccc7b89afa3 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008713 May 20 09:20:12.891937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 446/911] 10.222.0.69 () {60 vars in 1155 bytes} [Fri May 20 09:20:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 20 09:20:12.899072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84bea02c-9653-4d7b-a9ed-cf593a2423f4 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Action: 'create', calling method: .version_select at 0x7f7c86c8fdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69238996", "metadata": {"Type": "work"}}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84bea02c-9653-4d7b-a9ed-cf593a2423f4 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Request method failure captured: May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 117 May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih11M4GGjs8VQhnQRJ6PHJ-086Eyhi2nlSJMPB-6IBKk6HfFQmA7y7gevqDobyK62rcGv1CkN9SGu0T93wywcguIsRuCRI-dZfarb66Ugh2hdUWAcB4p-WvE4hvAChpZDrXWg5-zrbdVSp28_UCgVUKj74fX7orOH5u1d42xl-2efqFc May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:12.901545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f730af25ff034a338304e09f55a9f596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f730af25ff034a338304e09f55a9f596", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}] May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: eea7c4e3e9844a3eb6e7508d9016f52b May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-69238996", "metadata": {"Type": "work"}}} May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:20:12.903239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-69238996', 'metadata': {'Type': 'work'}}}} May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise error May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi On instance['volume']: May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi '' May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:12.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 20 09:20:12.910686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 20 09:20:12.911892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 20 09:20:12.911892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:12.911892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84bea02c-9653-4d7b-a9ed-cf593a2423f4 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:12.911892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-84bea02c-9653-4d7b-a9ed-cf593a2423f4 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008197 May 20 09:20:12.911892 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 466/912] 10.222.0.69 () {60 vars in 1155 bytes} [Fri May 20 09:20:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:12.914840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-679ccfdb-1ae3-48e2-9c54-26e8d25a5035 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Calling method '.version_select at 0x7f7c876994c0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:12.944611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-679ccfdb-1ae3-48e2-9c54-26e8d25a5035 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] HTTP exception thrown: Volume tempest-invalid-1354617778 could not be found. May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-679ccfdb-1ae3-48e2-9c54-26e8d25a5035 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Request method failure captured: May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1354617778 HTTP/1.1 May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih11M4GGjs8VQhnQRJ6PHJ-086Eyhi2nlSJMPB-6IBKk6HfFQmA7y7gevqDobyK62rcGv1CkN9SGu0T93wywcguIsRuCRI-dZfarb66Ugh2hdUWAcB4p-WvE4hvAChpZDrXWg5-zrbdVSp28_UCgVUKj74fX7orOH5u1d42xl-2efqFc May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:12.947951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f730af25ff034a338304e09f55a9f596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f730af25ff034a338304e09f55a9f596", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}] May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: eea7c4e3e9844a3eb6e7508d9016f52b May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Volume tempest-invalid-1354617778 could not be found. May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'tempest-invalid-1354617778'} May 20 09:20:12.949255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1354617778 could not be found. (HTTP 404) (Request-ID: req-b3cb8189-170c-4469-98bf-69591fd4b93a) May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.950085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 20 09:20:12.951566 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1354617778 could not be found. May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:12.953610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1354617778 could not be found. May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1354617778 could not be found. May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-679ccfdb-1ae3-48e2-9c54-26e8d25a5035 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Returning 404 to user: Volume tempest-invalid-1354617778 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-679ccfdb-1ae3-48e2-9c54-26e8d25a5035 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1354617778" status: 404 len: 99 microversion: 2.1 time: 0.039545 May 20 09:20:12.955185 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 447/913] 10.222.0.69 () {58 vars in 1217 bytes} [Fri May 20 09:20:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1354617778 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 20 09:20:12.960960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dbeb83bb-878c-4ce4-840b-fcfcbef4669f tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003813 May 20 09:20:12.961450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 467/914] 10.222.0.69 () {58 vars in 1139 bytes} [Fri May 20 09:20:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 20 09:20:12.970072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9c02affd-a772-488a-98a3-2e1f95680727 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003781 May 20 09:20:12.970701 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 448/915] 10.222.0.69 () {58 vars in 1136 bytes} [Fri May 20 09:20:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 20 09:20:12.978949 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-868bea02-27d3-4383-8e40-a6f0aab3afe9 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Calling method '.version_select at 0x7f7c86e36790>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:13.007666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-868bea02-27d3-4383-8e40-a6f0aab3afe9 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] HTTP exception thrown: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-868bea02-27d3-4383-8e40-a6f0aab3afe9 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Request method failure captured: May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/os-volumes/5817d0db-886a-431f-9e73-a08e074361af HTTP/1.1 May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih11M4GGjs8VQhnQRJ6PHJ-086Eyhi2nlSJMPB-6IBKk6HfFQmA7y7gevqDobyK62rcGv1CkN9SGu0T93wywcguIsRuCRI-dZfarb66Ugh2hdUWAcB4p-WvE4hvAChpZDrXWg5-zrbdVSp28_UCgVUKj74fX7orOH5u1d42xl-2efqFc May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:13.010294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f730af25ff034a338304e09f55a9f596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f730af25ff034a338304e09f55a9f596", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}] May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesNegativeTest-1323972642 May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: eea7c4e3e9844a3eb6e7508d9016f52b May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '5817d0db-886a-431f-9e73-a08e074361af'} May 20 09:20:13.011687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. (HTTP 404) (Request-ID: req-0e637ca8-4c2b-4e33-ae1c-a849a7c8dfa2) May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:13.012485 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 20 09:20:13.013757 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 20 09:20:13.014877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-868bea02-27d3-4383-8e40-a6f0aab3afe9 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Returning 404 to user: Volume 5817d0db-886a-431f-9e73-a08e074361af could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-868bea02-27d3-4383-8e40-a6f0aab3afe9 tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/5817d0db-886a-431f-9e73-a08e074361af" status: 404 len: 109 microversion: 2.1 time: 0.036499 May 20 09:20:13.018105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 468/916] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:20:12 2022] DELETE /compute/v2.1/os-volumes/5817d0db-886a-431f-9e73-a08e074361af => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:13.021791 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-77b95759-c6af-4192-824d-f873bc08967d tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Calling method '.version_select at 0x7f7c876389d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:13.050247 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-77b95759-c6af-4192-824d-f873bc08967d tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] HTTP exception thrown: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-77b95759-c6af-4192-824d-f873bc08967d tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Request method failure captured: May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/os-volumes/349eebe1-333d-4b18-82dc-7ed665eccba2 HTTP/1.1 May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih11M4GGjs8VQhnQRJ6PHJ-086Eyhi2nlSJMPB-6IBKk6HfFQmA7y7gevqDobyK62rcGv1CkN9SGu0T93wywcguIsRuCRI-dZfarb66Ugh2hdUWAcB4p-WvE4hvAChpZDrXWg5-zrbdVSp28_UCgVUKj74fX7orOH5u1d42xl-2efqFc May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:13.052277 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f730af25ff034a338304e09f55a9f596"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f730af25ff034a338304e09f55a9f596", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f730af25ff034a338304e09f55a9f596"}]}] May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-1323972642 May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f730af25ff034a338304e09f55a9f596 May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-1323972642 May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: eea7c4e3e9844a3eb6e7508d9016f52b May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-1323972642-project May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '349eebe1-333d-4b18-82dc-7ed665eccba2'} May 20 09:20:13.053835 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. (HTTP 404) (Request-ID: req-32fce408-f5dd-4729-a4c2-405b338fc0f6) May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:13.055575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:20:13.056722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 20 09:20:13.057895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-77b95759-c6af-4192-824d-f873bc08967d tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] Returning 404 to user: Volume 349eebe1-333d-4b18-82dc-7ed665eccba2 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-77b95759-c6af-4192-824d-f873bc08967d tempest-VolumesNegativeTest-1323972642 tempest-VolumesNegativeTest-1323972642-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/349eebe1-333d-4b18-82dc-7ed665eccba2" status: 404 len: 109 microversion: 2.1 time: 0.035774 May 20 09:20:13.059036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 449/917] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:13 2022] GET /compute/v2.1/os-volumes/349eebe1-333d-4b18-82dc-7ed665eccba2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:13.411274 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-851c7e53-6e03-4d91-a2e6-ca49e5e69840 req-b98741be-a887-4417-abe9-4637a1fe1420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18f53dc-1246-48a4-89c6-0872683b41a6", "tag": "b5598616-768d-4048-8257-a24495be6820"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:13.420262 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-851c7e53-6e03-4d91-a2e6-ca49e5e69840 req-b98741be-a887-4417-abe9-4637a1fe1420 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:13.420675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-851c7e53-6e03-4d91-a2e6-ca49e5e69840 req-b98741be-a887-4417-abe9-4637a1fe1420 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:13.431813 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-851c7e53-6e03-4d91-a2e6-ca49e5e69840 req-b98741be-a887-4417-abe9-4637a1fe1420 service nova] Creating event network-changed:b5598616-768d-4048-8257-a24495be6820 for instance f18f53dc-1246-48a4-89c6-0872683b41a6 on hv-cinder-83699 May 20 09:20:13.437187 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-851c7e53-6e03-4d91-a2e6-ca49e5e69840 req-b98741be-a887-4417-abe9-4637a1fe1420 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029618 May 20 09:20:13.438019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 469/918] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:19.071449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:19.072432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:19.078736 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.079288 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.080115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.080638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.109614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-433ecd16-a626-4315-abcb-e4873a6ac061 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043790 May 20 09:20:19.110510 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 450/919] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:20:19 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:20:19.217398 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:19.218405 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:19.225451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.226571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.227369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.227797 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.257835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fef5148e-237c-4f1c-98bf-4f4e42ea69be tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044556 May 20 09:20:19.258275 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 470/920] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:20:19 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:20:19.326250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:19.326685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:19.333501 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.334149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.334910 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.335534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.361336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:20:19.442886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-10d8d373-d802-4298-a052-583e549f41fd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 204 len: 0 microversion: 2.1 time: 0.120337 May 20 09:20:19.443724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 451/921] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:19 2022] DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:20:19.452460 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:19.453067 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:19.459175 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.459663 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.460413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:19.460842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:19.596019 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:19.603684 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-45171043-8a0e-4813-bfe5-2a3bdec2e0d8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.155105 May 20 09:20:19.604253 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 471/922] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:19 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:20.626605 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:20.627809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:20.640182 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:20.640618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:20.641747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:20.643394 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:20.787029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:20.794832 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-33519725-c662-44e0-b6b1-a597d6d26d56 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.175513 May 20 09:20:20.795432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 452/923] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:20 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:21.817042 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:21.817686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:21.824853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:21.825291 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:21.826043 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:21.830915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:21.976107 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:21.984230 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-df7e8bef-a56e-4615-82e0-f2d2353e8b97 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.171216 May 20 09:20:21.984804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 472/924] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:21 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:23.003633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:23.004217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:23.010883 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:23.011386 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:23.012428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:23.012908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:23.173308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:23.185778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-22e9f534-ce92-472c-980f-f88961617186 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.186136 May 20 09:20:23.186342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 453/925] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:22 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:24.205150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:24.206421 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:24.211159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=64 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:24.215397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:24.215968 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:24.216751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:24.217224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:24.350945 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:24.358673 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-29a21990-7d8d-4a3a-ad6e-12a1ed848bc8 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.157468 May 20 09:20:24.359471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 473/926] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:24 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:25.375985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:25.376619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:25.386090 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:25.386544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:25.387339 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:25.387777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:25.517739 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:25.525532 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8133f907-d4ef-472f-9d5c-97190ea6831c tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.153487 May 20 09:20:25.526113 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 454/927] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:25 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:26.544941 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:26.546587 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:26.555092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:26.555567 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:26.556378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:26.557877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:26.586772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:26.803771 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:26.812303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-19c50f4b-404e-4427-9213-088576a113c0 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1674 microversion: 2.1 time: 0.273474 May 20 09:20:26.813505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 474/928] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:26 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:27.522946 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6cc6b586-f2ca-44bf-9d4a-1bdf7269e8b4 req-5b934bb8-0cb9-4dae-b29f-386ae52dd7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a725791-6ff4-480f-8bce-77731edd3aad", "name": "network-vif-deleted", "tag": "6c738cd6-fb28-423a-8cab-3d62c2f21538"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:27.534524 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6cc6b586-f2ca-44bf-9d4a-1bdf7269e8b4 req-5b934bb8-0cb9-4dae-b29f-386ae52dd7e9 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:27.539890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6cc6b586-f2ca-44bf-9d4a-1bdf7269e8b4 req-5b934bb8-0cb9-4dae-b29f-386ae52dd7e9 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:27.553177 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6cc6b586-f2ca-44bf-9d4a-1bdf7269e8b4 req-5b934bb8-0cb9-4dae-b29f-386ae52dd7e9 service nova] Creating event network-vif-deleted:6c738cd6-fb28-423a-8cab-3d62c2f21538 for instance 1a725791-6ff4-480f-8bce-77731edd3aad on hv-cinder-83699 May 20 09:20:27.560029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6cc6b586-f2ca-44bf-9d4a-1bdf7269e8b4 req-5b934bb8-0cb9-4dae-b29f-386ae52dd7e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040707 May 20 09:20:27.561094 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 455/929] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:27.848748 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:27.849187 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:27.855983 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:27.856459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:27.857231 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:27.860337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:28.207001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:28.214822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3993841d-ef98-40d8-a492-92ab1faa6bfa tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1321 microversion: 2.1 time: 0.389061 May 20 09:20:28.215445 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 475/930] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:27 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:29.238412 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:29.239608 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:29.242644 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:29.251979 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:29.252716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:29.253972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:29.254695 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:29.321313 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:29.329060 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ec874cb0-948d-4b50-8ea3-32bb10c06d00 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1321 microversion: 2.1 time: 0.098975 May 20 09:20:29.329624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 456/931] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:29 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1321 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:30.350546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:30.351610 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:30.362723 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:30.363536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:30.364795 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:30.365519 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:30.439221 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaaa367491745708334c5f35331bf76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35ce1fcbd4038a0c556a45059c7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:30.447144 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-58ef84bd-f709-45eb-9c1c-179234a25afd tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 200 len: 1321 microversion: 2.1 time: 0.103148 May 20 09:20:30.447769 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 476/932] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:30 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 1321 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:31.472263 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:31.473181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:31.482515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:31.482968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:31.483762 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:31.484193 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:31.498301 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] HTTP exception thrown: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Request method failure captured: May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad HTTP/1.1 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vAmwwX9ChFgdWDaEZEF1AWwlRZOX6hb7SJpuDd1OZ0SXUuQREBohBSryd-dnW6bhdprojHhoH5aWonHuxOm6LOKBcAUX81fTLFpJzXWjeqkrff7RWrh9kXlm80kOeZJNgqtXLi4F0pHeIki64z3oK9aSw6pSysYGyZNWeVQYKW6p0 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:31.500004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dd35ce1fcbd4038a0c556a45059c7d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}] May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bfaaa367491745708334c5f35331bf76 May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:31.501624 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '1a725791-6ff4-480f-8bce-77731edd3aad'} May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:31.502553 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:31.504147 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:31.505871 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Returning 404 to user: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:31.505871 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-df198ace-f825-44c8-80a1-2da7df156900 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 404 len: 111 microversion: 2.1 time: 0.035546 May 20 09:20:31.505871 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 457/933] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:31 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:31.510397 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3d6d032a-266c-4942-8241-90eb93d1da3b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '.version_select at 0x7f7c86e36790>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:31.532225 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3d6d032a-266c-4942-8241-90eb93d1da3b tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817386003" status: 202 len: 0 microversion: 2.1 time: 0.025697 May 20 09:20:31.532838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 477/934] 10.222.0.69 () {58 vars in 1217 bytes} [Fri May 20 09:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817386003 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:20:34.469749 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:34.470237 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:34.477076 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:34.477524 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:34.478276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:34.478701 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:34.492618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] HTTP exception thrown: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Request method failure captured: May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad HTTP/1.1 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vAmwwX9ChFgdWDaEZEF1AWwlRZOX6hb7SJpuDd1OZ0SXUuQREBohBSryd-dnW6bhdprojHhoH5aWonHuxOm6LOKBcAUX81fTLFpJzXWjeqkrff7RWrh9kXlm80kOeZJNgqtXLi4F0pHeIki64z3oK9aSw6pSysYGyZNWeVQYKW6p0 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:34.494160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dd35ce1fcbd4038a0c556a45059c7d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}] May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bfaaa367491745708334c5f35331bf76 May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.495720 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '1a725791-6ff4-480f-8bce-77731edd3aad'} May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:34.496477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.497755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:34.499316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Returning 404 to user: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:34.499316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c8aaf892-eb5f-47b8-b42f-3f4b4c7cf8a7 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 404 len: 111 microversion: 2.1 time: 0.029648 May 20 09:20:34.499316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 458/935] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:34 2022] DELETE /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:34.505289 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:34.505906 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: 1a725791-6ff4-480f-8bce-77731edd3aad] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:34.513032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:34.513480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:34.514241 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:34.514721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:34.529131 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] HTTP exception thrown: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Request method failure captured: May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad HTTP/1.1 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vAmwwX9ChFgdWDaEZEF1AWwlRZOX6hb7SJpuDd1OZ0SXUuQREBohBSryd-dnW6bhdprojHhoH5aWonHuxOm6LOKBcAUX81fTLFpJzXWjeqkrff7RWrh9kXlm80kOeZJNgqtXLi4F0pHeIki64z3oK9aSw6pSysYGyZNWeVQYKW6p0 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:34.530782 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dd35ce1fcbd4038a0c556a45059c7d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}] May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: bfaaa367491745708334c5f35331bf76 May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.532591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '1a725791-6ff4-480f-8bce-77731edd3aad'} May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:34.533637 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. May 20 09:20:34.535163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:34.536505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Returning 404 to user: Instance 1a725791-6ff4-480f-8bce-77731edd3aad could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:34.536505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-36c31a5a-b1d3-4444-93aa-f9bb7b2cc48a tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad" status: 404 len: 111 microversion: 2.1 time: 0.031531 May 20 09:20:34.536505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 478/936] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:34 2022] GET /compute/v2.1/servers/1a725791-6ff4-480f-8bce-77731edd3aad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:34.924290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:34.924785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:34.931072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:34.931561 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:34.932314 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:34.932743 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:35.018131 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lazy-loading 'services' on Instance uuid 1d658381-710d-4b21-b9e9-5661c178a89a {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:20:35.106069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b706ba7c-9511-4249-b692-bd1018be6311 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a/os-volume_attachments/2abcf09f-85cf-480f-bdcd-17afcda327f7" status: 202 len: 0 microversion: 2.1 time: 0.185583 May 20 09:20:35.106778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 459/937] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:20:34 2022] DELETE /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a/os-volume_attachments/2abcf09f-85cf-480f-bdcd-17afcda327f7 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:20:35.671671 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:35.672247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:35.679465 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:35.679921 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:35.680670 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:35.681107 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:35.695253 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] HTTP exception thrown: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Request method failure captured: May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 HTTP/1.1 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vAmwwX9ChFgdWDaEZEF1AWwlRZOX6hb7SJpuDd1OZ0SXUuQREBohBSryd-dnW6bhdprojHhoH5aWonHuxOm6LOKBcAUX81fTLFpJzXWjeqkrff7RWrh9kXlm80kOeZJNgqtXLi4F0pHeIki64z3oK9aSw6pSysYGyZNWeVQYKW6p0 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:35.696891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dd35ce1fcbd4038a0c556a45059c7d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}] May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: bfaaa367491745708334c5f35331bf76 May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.698604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'e99280ff-b8f3-420b-ba9a-e6e5686de569'} May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:35.699775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.701345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:35.703094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Returning 404 to user: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:35.703094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1b244c4c-8173-4074-bcd4-09e6089e4015 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 404 len: 111 microversion: 2.1 time: 0.030726 May 20 09:20:35.703094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 479/938] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:35 2022] DELETE /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:35.708823 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:35.709508 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] [instance: e99280ff-b8f3-420b-ba9a-e6e5686de569] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:35.715964 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:35.716424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:35.717235 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:35.717667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:35.731029 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] HTTP exception thrown: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Request method failure captured: May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 HTTP/1.1 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vAmwwX9ChFgdWDaEZEF1AWwlRZOX6hb7SJpuDd1OZ0SXUuQREBohBSryd-dnW6bhdprojHhoH5aWonHuxOm6LOKBcAUX81fTLFpJzXWjeqkrff7RWrh9kXlm80kOeZJNgqtXLi4F0pHeIki64z3oK9aSw6pSysYGyZNWeVQYKW6p0 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:35.732827 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9dd35ce1fcbd4038a0c556a45059c7d7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9dd35ce1fcbd4038a0c556a45059c7d7"}]}] May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 9dd35ce1fcbd4038a0c556a45059c7d7 May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1945366603 May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bfaaa367491745708334c5f35331bf76 May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeTestJSON-1945366603-project May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.734874 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'e99280ff-b8f3-420b-ba9a-e6e5686de569'} May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:35.735991 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. May 20 09:20:35.737458 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:35.739687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] Returning 404 to user: Instance e99280ff-b8f3-420b-ba9a-e6e5686de569 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:35.739687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-122dd613-9371-4c5f-9749-25900cdac8c9 tempest-AttachVolumeTestJSON-1945366603 tempest-AttachVolumeTestJSON-1945366603-project] 10.222.0.69 "GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569" status: 404 len: 111 microversion: 2.1 time: 0.030273 May 20 09:20:35.739687 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 460/939] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:35 2022] GET /compute/v2.1/servers/e99280ff-b8f3-420b-ba9a-e6e5686de569 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 20 09:20:36.227998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:36.228490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:36.234477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:36.234918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:36.235699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:36.236129 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:36.261075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:20:36.344395 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-84a9d972-371d-4149-9f27-e428929ca886 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "DELETE /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 204 len: 0 microversion: 2.1 time: 0.120066 May 20 09:20:36.344999 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 480/940] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:20:36 2022] DELETE /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:20:36.355018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:36.355018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:36.360283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:36.360728 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:36.361487 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:36.361914 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:36.377217 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:36.496591 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:36.505547 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-25f796b9-fa29-470f-8b62-1164faf3357f tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1514 microversion: 2.1 time: 0.156107 May 20 09:20:36.506105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 461/941] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:36 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:37.523691 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:37.524300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:37.531277 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:37.531749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:37.532518 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:37.532959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:37.669507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:37.681053 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-20065f33-4e1f-4571-ad45-e95831818ac7 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1514 microversion: 2.1 time: 0.162047 May 20 09:20:37.691511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 481/942] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:37 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:38.699290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:38.699977 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:38.715218 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:38.715819 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:38.716763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:38.720444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:38.798392 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-a3d11a77-49c4-475c-8747-9ad29306366a req-03a61d8e-919a-4e1a-94e0-4f2675a64efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d658381-710d-4b21-b9e9-5661c178a89a", "name": "network-vif-deleted", "tag": "c3e846d0-f6ed-4db9-8d76-e7c2a2fd731d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:38.822436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-a3d11a77-49c4-475c-8747-9ad29306366a req-03a61d8e-919a-4e1a-94e0-4f2675a64efc service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:38.823420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-a3d11a77-49c4-475c-8747-9ad29306366a req-03a61d8e-919a-4e1a-94e0-4f2675a64efc service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:38.834625 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:38.848157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c1fe454e-d4cd-406d-bfc3-fe30da136f9c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 200 len: 1472 microversion: 2.1 time: 0.153197 May 20 09:20:38.849828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 462/943] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:38 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:38.855299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-a3d11a77-49c4-475c-8747-9ad29306366a req-03a61d8e-919a-4e1a-94e0-4f2675a64efc service nova] Creating event network-vif-deleted:c3e846d0-f6ed-4db9-8d76-e7c2a2fd731d for instance 1d658381-710d-4b21-b9e9-5661c178a89a on hv-cinder-83699 May 20 09:20:38.862334 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-a3d11a77-49c4-475c-8747-9ad29306366a req-03a61d8e-919a-4e1a-94e0-4f2675a64efc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071357 May 20 09:20:38.863821 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 482/944] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:39.866556 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:39.867168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 1d658381-710d-4b21-b9e9-5661c178a89a] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:39.873873 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:39.874319 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:39.875078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:39.875530 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:39.890154 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] HTTP exception thrown: Instance 1d658381-710d-4b21-b9e9-5661c178a89a could not be found. May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Request method failure captured: May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a HTTP/1.1 May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih10tmMZiKJ78zuWgWUqBN0LiYhL47Di54ukS-vSXodNzAFFK1jvsl38oENDY--sR_qo_P4PmHtQFioic73qJK-VKznjM6TPjJnCPa4rofHuVa4Qek38EzohVud3nVNuCigoeZtdEHLr0Gw2HzOFJGYfuNskWyGNg9qGiK83AK-6UL1Q May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: e619f7d90e8543ba85f3bbaba9046c72 May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2128801322 May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:39.893081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e619f7d90e8543ba85f3bbaba9046c72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e619f7d90e8543ba85f3bbaba9046c72", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e619f7d90e8543ba85f3bbaba9046c72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e619f7d90e8543ba85f3bbaba9046c72"}]}] May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesSnapshotTestJSON-2128801322 May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e619f7d90e8543ba85f3bbaba9046c72 May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2128801322 May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesSnapshotTestJSON-2128801322-project May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 661271a657a548468ff85fe298e0c5f9 May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesSnapshotTestJSON-2128801322-project May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 1d658381-710d-4b21-b9e9-5661c178a89a could not be found. May 20 09:20:39.894439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '1d658381-710d-4b21-b9e9-5661c178a89a'} May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d658381-710d-4b21-b9e9-5661c178a89a could not be found. May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:39.895253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d658381-710d-4b21-b9e9-5661c178a89a could not be found. May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d658381-710d-4b21-b9e9-5661c178a89a could not be found. May 20 09:20:39.896522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:39.897641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Returning 404 to user: Instance 1d658381-710d-4b21-b9e9-5661c178a89a could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:39.897641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-92add594-379d-48df-a024-ee0db9d35640 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a" status: 404 len: 111 microversion: 2.1 time: 0.031860 May 20 09:20:39.897641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 463/945] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:39 2022] GET /compute/v2.1/servers/1d658381-710d-4b21-b9e9-5661c178a89a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:20:39.993533 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:39.994834 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:40.003229 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:40.004248 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:40.005216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:40.005881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:40.050365 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7059fc5e-bcc0-46a1-a2ca-a6c9a9410bab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063105 May 20 09:20:40.056092 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 483/946] 10.222.0.69 () {60 vars in 1342 bytes} [Fri May 20 09:20:39 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:40.150674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:40.151497 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:40.159645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:40.160531 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:40.161777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:40.162512 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:40.189678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:20:40.290049 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a019fb87-60a7-4ee2-89d7-c24cc526eb4e tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 204 len: 0 microversion: 2.20 time: 0.144312 May 20 09:20:40.290812 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 464/947] 10.222.0.69 () {60 vars in 1279 bytes} [Fri May 20 09:20:40 2022] DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 20 09:20:40.299599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:40.300588 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:40.307111 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:40.307683 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:40.308548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:40.309091 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:40.462676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:40.472431 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:40.474356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:40.475564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-412188c7-5b4b-4563-ad64-5fa500247f13 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.180252 May 20 09:20:40.476295 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 484/948] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:40 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:20:41.498086 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:41.499070 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:41.505683 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:41.506325 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:41.507085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:41.507579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:41.653706 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:41.663611 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:41.665581 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:41.667881 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-db7fb91e-ccf4-4814-9081-6753181a3683 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.177115 May 20 09:20:41.671291 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 465/949] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:41 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:20:42.686269 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:42.686785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:42.693120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:42.693573 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:42.694326 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:42.694751 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:42.844036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:42.853240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:42.855015 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:42.856515 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4b71887a-8a66-4825-b494-0ef47419b631 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1721 microversion: 2.20 time: 0.174397 May 20 09:20:42.857244 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 485/950] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:42 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:20:43.884814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:43.885569 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:43.894403 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:43.894872 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:43.895648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:43.896079 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:43.984265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:43.993771 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:43.995578 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7e574dc676841dea1f23a06c333ff14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bf8a2fea6243c28aff53d39a57f92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:44.000663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-02b8ae33-1de9-4f44-ba4c-f4aabb24568f tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 200 len: 1654 microversion: 2.20 time: 0.126322 May 20 09:20:44.003212 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 466/951] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:43 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 1654 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 20 09:20:44.333018 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-c16f789e-f3d3-462d-9cfc-14b8e5bd94aa req-0f2228ba-9a90-442d-8296-ae6ed13595ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b8a799-7b88-4862-8b6d-87faa7d907f8", "name": "network-vif-deleted", "tag": "0fff114c-fe55-4714-bbdc-e879108b685e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:44.364361 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c16f789e-f3d3-462d-9cfc-14b8e5bd94aa req-0f2228ba-9a90-442d-8296-ae6ed13595ff service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:44.365371 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-c16f789e-f3d3-462d-9cfc-14b8e5bd94aa req-0f2228ba-9a90-442d-8296-ae6ed13595ff service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:44.403457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-c16f789e-f3d3-462d-9cfc-14b8e5bd94aa req-0f2228ba-9a90-442d-8296-ae6ed13595ff service nova] Creating event network-vif-deleted:0fff114c-fe55-4714-bbdc-e879108b685e for instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 on hv-cinder-83699 May 20 09:20:44.412642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-c16f789e-f3d3-462d-9cfc-14b8e5bd94aa req-0f2228ba-9a90-442d-8296-ae6ed13595ff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089360 May 20 09:20:44.418102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 486/952] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:45.022805 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:45.024163 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:45.032744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:45.033351 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:45.034226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:45.034831 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:45.053422 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] HTTP exception thrown: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Request method failure captured: May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 HTTP/1.1 May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBVQMz1shIyBDx8NSCwVhGyOZPuo9OwulvZ_SFHD4v7Wz2hkX6nF-wv9_TZWP8N7uShME3tfR5lrz7f4S0idXwihsSGogMSR8Gp0aHNg0dTE9sgQXftqoIsG1r4g84vYc9WKIeV4HsADsLvTbnYf94g8LGS3LNuPHOHjErNY62eBQ May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Openstack-Nova-Api-Version: 2.20 May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:45.055251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92bf8a2fea6243c28aff53d39a57f92c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}] May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: a7e574dc676841dea1f23a06c333ff14 May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:45.057746 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '53b8a799-7b88-4862-8b6d-87faa7d907f8'} May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:45.058778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:45.060648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:45.063016 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Returning 404 to user: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:45.063016 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-95423da9-aa9c-44a7-a9e9-0ce5e2bc2bce tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 404 len: 111 microversion: 2.20 time: 0.042301 May 20 09:20:45.065086 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 467/953] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:45 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:45.071107 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ace2a3b1-3658-4218-88d9-2a538ecbbb5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '.version_select at 0x7f7c86f3e5e0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:45.091430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ace2a3b1-3658-4218-88d9-2a538ecbbb5d tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472723151" status: 204 len: 0 microversion: 2.20 time: 0.025162 May 20 09:20:45.092104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 487/954] 10.222.0.69 () {60 vars in 1258 bytes} [Fri May 20 09:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472723151 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 20 09:20:47.950582 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1168946696", "imageRef": "af1effee-551e-4a81-8cef-b761ce3329dc", "flavorRef": "452", "networks": [{"uuid": "7c4daf32-ed58-4d1f-a204-f678b6d4c5c3"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:48.000575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] validate_networks() for [('7c4daf32-ed58-4d1f-a204-f678b6d4c5c3', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:20:48.350309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:20:48.350758 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:20:48.351245 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:20:48.351686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:20:48.352099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:20:48.361408 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:48.361852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:48.362638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:48.363066 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:48.381284 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Getting quotas for project e619f7d90e8543ba85f3bbaba9046c72. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:20:48.385341 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Getting quotas for user 661271a657a548468ff85fe298e0c5f9 and project e619f7d90e8543ba85f3bbaba9046c72. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:20:48.397293 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:20:48.399642 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af1effee-551e-4a81-8cef-b761ce3329dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:20:48.449460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ff918e6e-4323-46a9-9b33-5472cd0b8aa3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502979 May 20 09:20:48.451428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 468/955] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:20:48.460157 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e9bc2ecb-1383-4817-b8cb-a7530cdaa641 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:48.461462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e9bc2ecb-1383-4817-b8cb-a7530cdaa641 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:48.517060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e9bc2ecb-1383-4817-b8cb-a7530cdaa641 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:48.525588 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e9bc2ecb-1383-4817-b8cb-a7530cdaa641 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1219 microversion: 2.1 time: 0.069100 May 20 09:20:48.526389 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 488/956] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:48 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:48.567572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:48.568067 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:48.575191 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:48.575633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:48.576516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:48.577122 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:48.593093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] HTTP exception thrown: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Request method failure captured: May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 HTTP/1.1 May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBVQMz1shIyBDx8NSCwVhGyOZPuo9OwulvZ_SFHD4v7Wz2hkX6nF-wv9_TZWP8N7uShME3tfR5lrz7f4S0idXwihsSGogMSR8Gp0aHNg0dTE9sgQXftqoIsG1r4g84vYc9WKIeV4HsADsLvTbnYf94g8LGS3LNuPHOHjErNY62eBQ May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Openstack-Nova-Api-Version: 2.20 May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:48.594674 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92bf8a2fea6243c28aff53d39a57f92c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}] May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: a7e574dc676841dea1f23a06c333ff14 May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.596106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '53b8a799-7b88-4862-8b6d-87faa7d907f8'} May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:48.596840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.598075 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:48.599302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Returning 404 to user: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:48.599302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a750f0de-da94-41d7-a233-dabc6140f3ed tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 404 len: 111 microversion: 2.20 time: 0.033035 May 20 09:20:48.599302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 469/957] 10.222.0.69 () {60 vars in 1279 bytes} [Fri May 20 09:20:48 2022] DELETE /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:48.606590 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:48.607763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: 53b8a799-7b88-4862-8b6d-87faa7d907f8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:48.619180 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:48.619645 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:48.620411 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:48.620841 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:48.634862 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] HTTP exception thrown: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Request method failure captured: May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 HTTP/1.1 May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBVQMz1shIyBDx8NSCwVhGyOZPuo9OwulvZ_SFHD4v7Wz2hkX6nF-wv9_TZWP8N7uShME3tfR5lrz7f4S0idXwihsSGogMSR8Gp0aHNg0dTE9sgQXftqoIsG1r4g84vYc9WKIeV4HsADsLvTbnYf94g8LGS3LNuPHOHjErNY62eBQ May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Openstack-Nova-Api-Version: 2.20 May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:48.636953 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92bf8a2fea6243c28aff53d39a57f92c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}] May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a7e574dc676841dea1f23a06c333ff14 May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.638564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '53b8a799-7b88-4862-8b6d-87faa7d907f8'} May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:48.639454 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. May 20 09:20:48.641061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:48.642240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Returning 404 to user: Instance 53b8a799-7b88-4862-8b6d-87faa7d907f8 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:48.642240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5d100f82-aa17-4801-8b88-807bf2ab3dab tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8" status: 404 len: 111 microversion: 2.20 time: 0.037018 May 20 09:20:48.642240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 489/958] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:48 2022] GET /compute/v2.1/servers/53b8a799-7b88-4862-8b6d-87faa7d907f8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:49.542988 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:49.544634 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:49.557276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:49.558013 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:49.558857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:49.559382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:49.651474 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:49.660686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-87d82ad8-0b25-4bd9-a248-56e088142566 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1289 microversion: 2.1 time: 0.121942 May 20 09:20:49.661449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 470/959] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:49 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:49.813308 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:49.816167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:49.828860 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:49.829303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:49.830074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:49.830501 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:49.848422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] HTTP exception thrown: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Request method failure captured: May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 HTTP/1.1 May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1vBVQMz1shIyBDx8NSCwVhGyOZPuo9OwulvZ_SFHD4v7Wz2hkX6nF-wv9_TZWP8N7uShME3tfR5lrz7f4S0idXwihsSGogMSR8Gp0aHNg0dTE9sgQXftqoIsG1r4g84vYc9WKIeV4HsADsLvTbnYf94g8LGS3LNuPHOHjErNY62eBQ May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Openstack-Nova-Api-Version: 2.20 May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:20:49.850093 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92bf8a2fea6243c28aff53d39a57f92c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}] May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: a7e574dc676841dea1f23a06c333ff14 May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.851523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': 'b7d7463c-5e56-405b-911d-9b7fa6d3f7d9'} May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:49.852436 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.854413 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:20:49.856121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Returning 404 to user: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:49.856121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2a3bd939-401d-4c8e-97a4-0b898115e599 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 404 len: 111 microversion: 2.20 time: 0.042435 May 20 09:20:49.856121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 490/960] 10.222.0.69 () {60 vars in 1279 bytes} [Fri May 20 09:20:49 2022] DELETE /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:49.860552 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:49.861163 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] [instance: b7d7463c-5e56-405b-911d-9b7fa6d3f7d9] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:49.867455 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:49.867911 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:49.868675 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:49.869110 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:49.883961 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] HTTP exception thrown: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Request method failure captured: May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 HTTP/1.1 May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1vBVQMz1shIyBDx8NSCwVhGyOZPuo9OwulvZ_SFHD4v7Wz2hkX6nF-wv9_TZWP8N7uShME3tfR5lrz7f4S0idXwihsSGogMSR8Gp0aHNg0dTE9sgQXftqoIsG1r4g84vYc9WKIeV4HsADsLvTbnYf94g8LGS3LNuPHOHjErNY62eBQ May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Openstack-Nova-Api-Version: 2.20 May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:20:49.885638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_92bf8a2fea6243c28aff53d39a57f92c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/92bf8a2fea6243c28aff53d39a57f92c"}]}] May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 92bf8a2fea6243c28aff53d39a57f92c May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-966816584 May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: a7e574dc676841dea1f23a06c333ff14 May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-966816584-project May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.887568 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'b7d7463c-5e56-405b-911d-9b7fa6d3f7d9'} May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:20:49.888307 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. May 20 09:20:49.889782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:20:49.891815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] Returning 404 to user: Instance b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:20:49.891815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-03ff6fa8-a13a-43e2-b467-3e488f1b3861 tempest-AttachVolumeShelveTestJSON-966816584 tempest-AttachVolumeShelveTestJSON-966816584-project] 10.222.0.69 "GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9" status: 404 len: 111 microversion: 2.20 time: 0.030764 May 20 09:20:49.891815 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 471/961] 10.222.0.69 () {60 vars in 1276 bytes} [Fri May 20 09:20:49 2022] GET /compute/v2.1/servers/b7d7463c-5e56-405b-911d-9b7fa6d3f7d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 20 09:20:50.677931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:50.678543 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:50.685004 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:50.685794 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:50.686770 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:50.687483 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:50.924292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:50.932505 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-74dc0113-e701-44cf-ad57-3374e7416562 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.258362 May 20 09:20:50.933261 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 491/962] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:50 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:51.074115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-7173320e-c584-4841-9d5a-d2155b810ad4 req-77077a9b-1557-4907-92fe-90e52788a152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43fcdc4c-b5f5-4ed1-819e-c916a953b508", "tag": "cef004e9-2264-426f-8575-fe483632a097"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:51.085976 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-7173320e-c584-4841-9d5a-d2155b810ad4 req-77077a9b-1557-4907-92fe-90e52788a152 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:51.086423 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-7173320e-c584-4841-9d5a-d2155b810ad4 req-77077a9b-1557-4907-92fe-90e52788a152 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:51.122382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-7173320e-c584-4841-9d5a-d2155b810ad4 req-77077a9b-1557-4907-92fe-90e52788a152 service nova] Creating event network-changed:cef004e9-2264-426f-8575-fe483632a097 for instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 on hv-cinder-83699 May 20 09:20:51.135097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-7173320e-c584-4841-9d5a-d2155b810ad4 req-77077a9b-1557-4907-92fe-90e52788a152 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065401 May 20 09:20:51.136183 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 472/963] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:51.949998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:51.950735 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:51.961140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:51.963161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:51.965616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:51.966271 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:52.257602 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:52.265479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-74114bc6-61b3-42f2-8ab3-c0d06a3f4b88 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.319510 May 20 09:20:52.270078 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 492/964] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:51 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:53.286261 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:53.287034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:53.293893 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:53.294406 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:53.295375 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:53.295871 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:53.525794 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:53.537235 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-47ea883e-d4d9-4734-80e6-5098266be191 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.256171 May 20 09:20:53.538563 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 473/965] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:53 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:54.558960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:54.560335 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:54.565854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:54.570369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:54.570918 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:54.571923 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:54.572576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:54.760474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:54.769474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4e2dcac1-8d21-4989-99ea-db00225ab819 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.218371 May 20 09:20:54.769474 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 493/966] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:54 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:55.786931 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:55.788212 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:55.802398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:55.803226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:55.804085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:55.804730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:55.998460 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:56.006539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dfaea94c-777f-46ec-9f58-39381bbca07c tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.224009 May 20 09:20:56.016015 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 474/967] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:55 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:56.016228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f275508d-6659-4fef-989b-a567cc8a3d24 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Action: 'create', calling method: .version_select at 0x7f7c86f3edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-332596457", "metadata": {"Type": "work"}}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:56.016682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-642650c2-37ac-4739-925c-fb11b34df837 req-b0d8b513-4ee5-4f3b-adf5-466b0c459f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43fcdc4c-b5f5-4ed1-819e-c916a953b508", "name": "network-vif-plugged", "status": "completed", "tag": "cef004e9-2264-426f-8575-fe483632a097"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:20:56.022181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-642650c2-37ac-4739-925c-fb11b34df837 req-b0d8b513-4ee5-4f3b-adf5-466b0c459f01 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:56.022616 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-642650c2-37ac-4739-925c-fb11b34df837 req-b0d8b513-4ee5-4f3b-adf5-466b0c459f01 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:56.049825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-642650c2-37ac-4739-925c-fb11b34df837 req-b0d8b513-4ee5-4f3b-adf5-466b0c459f01 service nova] Creating event network-vif-plugged:cef004e9-2264-426f-8575-fe483632a097 for instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 on hv-cinder-83699 May 20 09:20:56.055003 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-642650c2-37ac-4739-925c-fb11b34df837 req-b0d8b513-4ee5-4f3b-adf5-466b0c459f01 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046214 May 20 09:20:56.056313 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 475/968] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:56.370668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f275508d-6659-4fef-989b-a567cc8a3d24 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.516554 May 20 09:20:56.371390 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 494/969] 10.222.0.69 () {60 vars in 1155 bytes} [Fri May 20 09:20:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 519 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 20 09:20:56.382847 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bc2c6af9-7c10-4cec-bc3e-48780cac9399 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c90814b80>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:56.433526 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bc2c6af9-7c10-4cec-bc3e-48780cac9399 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 200 len: 352 microversion: 2.1 time: 0.054920 May 20 09:20:56.434097 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 476/970] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:56 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:57.024074 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:57.024685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:57.031864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:57.032313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:57.033080 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:57.033767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:57.038027 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:57.164622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:57.172187 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3d771561-209c-4048-bfb5-6e3fac6b9291 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.152562 May 20 09:20:57.172753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 495/971] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:57 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:57.447208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fa3dadd2-7148-496f-9be5-b6ac7a704e87 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c87686940>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:57.497239 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fa3dadd2-7148-496f-9be5-b6ac7a704e87 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 200 len: 353 microversion: 2.1 time: 0.054763 May 20 09:20:57.497855 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 477/972] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:57 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:57.508945 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c33cf537-501d-4169-a651-7d2e65d5166b tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c86f3edc0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:57.556569 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c33cf537-501d-4169-a651-7d2e65d5166b tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 200 len: 353 microversion: 2.1 time: 0.051358 May 20 09:20:57.557228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 496/973] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:57 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:57.572822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-256a94eb-564b-4365-aebb-714b3637893a tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c90809f70>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:57.637540 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-256a94eb-564b-4365-aebb-714b3637893a tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 202 len: 0 microversion: 2.1 time: 0.068284 May 20 09:20:57.638712 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 478/974] 10.222.0.69 () {58 vars in 1247 bytes} [Fri May 20 09:20:57 2022] DELETE /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:20:57.648208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-523af1f2-f58c-4378-acbb-c74e48be80e1 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c86edcca0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:57.697823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-523af1f2-f58c-4378-acbb-c74e48be80e1 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 200 len: 352 microversion: 2.1 time: 0.054392 May 20 09:20:57.698386 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 497/975] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:57 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:58.189308 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:58.190052 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:58.196472 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:58.196937 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:58.198028 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:58.198149 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:58.374022 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:58.377022 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:58.385062 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-885eb65b-8dd6-42c5-8d21-b34dc800910d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.199797 May 20 09:20:58.385638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 479/976] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:58 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:58.707466 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:58.711707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-27792880-0d33-4da7-883e-92aee9cf0bc1 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c86dceb80>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:58.759699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-27792880-0d33-4da7-883e-92aee9cf0bc1 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 200 len: 352 microversion: 2.1 time: 0.053193 May 20 09:20:58.760305 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 498/977] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:58 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:20:59.402305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:59.403031 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:20:59.405929 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:59.407410 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:20:59.411366 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:59.411803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:59.412765 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:20:59.413362 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:20:59.566575 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:20:59.573945 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b0418f42-99ad-4586-9d2b-6a81ae1be13d tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1319 microversion: 2.1 time: 0.175514 May 20 09:20:59.574725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 480/978] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:20:59 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:20:59.776083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7de8e912-d122-4ca8-9e00-79eb7f8e96f4 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c86cefaf0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:20:59.825316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7de8e912-d122-4ca8-9e00-79eb7f8e96f4 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 200 len: 352 microversion: 2.1 time: 0.052902 May 20 09:20:59.825959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 499/979] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:20:59 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:21:00.592106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:00.592696 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:00.599685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:00.600132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:00.600860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:00.601321 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:00.732348 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:21:00.740592 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ff10476f-902f-4ca8-97ad-db57d2c7cebc tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1508 microversion: 2.1 time: 0.152437 May 20 09:21:00.741132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 481/980] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:21:00 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:21:00.757174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7e05b4-b49e-4823-aaae-67db8f9db3a5", "device": "/dev/sdb"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:21:00.758336 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:00.764812 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:00.765258 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:00.766365 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:00.766796 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:00.838091 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b6ae2fd9-abe8-4b3e-b002-7717d2700666 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Calling method '.version_select at 0x7f7c8769bc10>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:00.866126 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-b6ae2fd9-abe8-4b3e-b002-7717d2700666 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] HTTP exception thrown: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b6ae2fd9-abe8-4b3e-b002-7717d2700666 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Request method failure captured: May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 HTTP/1.1 May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih113Sl4DToB3orLnv6wMBVZiZRpi2c1VmHR5-WQjPO1DpN6aqjIsAnfVHXj0-tSkhgjspZ8IgGoJzB-pcOye46AP-mNGxAvB9BYmwIMLZwK9p-I9NyTxsGZii9qE7M26TdzR_MWBw-6xTaJgrCIjLGsBakNez8iwwnhwhofXGvDe6vg May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 88c57cc932054d21a371617817d0b4b5 May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesGetTestJSON-894308844 May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:21:00.868274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/88c57cc932054d21a371617817d0b4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_88c57cc932054d21a371617817d0b4b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88c57cc932054d21a371617817d0b4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/88c57cc932054d21a371617817d0b4b5"}]}] May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesGetTestJSON-894308844 May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 88c57cc932054d21a371617817d0b4b5 May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesGetTestJSON-894308844 May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesGetTestJSON-894308844-project May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: eb63369fbc5941588e6e2af9b35c0000 May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesGetTestJSON-894308844-project May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '0a149fda-ffd0-4b58-b213-459f50cc8a65'} May 20 09:21:00.869732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. (HTTP 404) (Request-ID: req-1ad17b65-19d3-4e6c-94d9-b9bf8012a7bd) May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:21:00.870534 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 20 09:21:00.871730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 20 09:21:00.872886 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b6ae2fd9-abe8-4b3e-b002-7717d2700666 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] Returning 404 to user: Volume 0a149fda-ffd0-4b58-b213-459f50cc8a65 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b6ae2fd9-abe8-4b3e-b002-7717d2700666 tempest-VolumesGetTestJSON-894308844 tempest-VolumesGetTestJSON-894308844-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65" status: 404 len: 109 microversion: 2.1 time: 0.035540 May 20 09:21:00.874059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 482/981] 10.222.0.69 () {58 vars in 1244 bytes} [Fri May 20 09:21:00 2022] GET /compute/v2.1/os-volumes/0a149fda-ffd0-4b58-b213-459f50cc8a65 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:21:01.037940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2079e45a-d533-41e0-be6c-4c1c3dc3b9e3 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "POST /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284728 May 20 09:21:01.040036 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 500/982] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:21:00 2022] POST /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:21:18.386434 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:18.387160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:18.393797 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:18.394485 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:18.403248 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:18.403725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:18.404517 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:18.404944 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:18.491048 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lazy-loading 'services' on Instance uuid 43fcdc4c-b5f5-4ed1-819e-c916a953b508 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:21:18.568857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-766574c7-f424-44a5-bf77-7f9bb86e9091 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508/os-volume_attachments/aa7e05b4-b49e-4823-aaae-67db8f9db3a5" status: 202 len: 0 microversion: 2.1 time: 0.183672 May 20 09:21:18.569442 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 483/983] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:21:18 2022] DELETE /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508/os-volume_attachments/aa7e05b4-b49e-4823-aaae-67db8f9db3a5 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:21:19.714824 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=5 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:19.715685 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:19.720662 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:19.723400 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:19.731496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:19.731978 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:19.732808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:19.733240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:19.760769 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:21:19.846766 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d7e3e198-84f1-4dc3-ab92-2c2a4b295249 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 204 len: 0 microversion: 2.1 time: 0.133287 May 20 09:21:19.847574 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 501/984] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:21:19 2022] DELETE /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:21:19.860916 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:19.861701 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:19.868865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:19.869309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:19.873296 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:19.873753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:20.023426 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:21:20.031333 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cf1a241a-7abc-415d-ae38-0117f48abd87 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1514 microversion: 2.1 time: 0.175478 May 20 09:21:20.032500 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 484/985] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:21:19 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:21:21.049026 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:21.049732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:21.056426 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:21.056864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:21.057823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:21.058262 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:21.204510 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:21:21.212203 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ad1bf938-58d5-4064-b41d-36234506a308 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1514 microversion: 2.1 time: 0.167781 May 20 09:21:21.213009 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 502/986] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:21:21 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:21:21.984667 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-8a5d7cdf-3fa6-420d-9e35-455e52742229 req-b84167cc-2785-47f7-9d98-d2c91e1dfe74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43fcdc4c-b5f5-4ed1-819e-c916a953b508", "name": "network-vif-deleted", "tag": "cef004e9-2264-426f-8575-fe483632a097"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:21:21.994365 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-8a5d7cdf-3fa6-420d-9e35-455e52742229 req-b84167cc-2785-47f7-9d98-d2c91e1dfe74 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:21.995055 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-8a5d7cdf-3fa6-420d-9e35-455e52742229 req-b84167cc-2785-47f7-9d98-d2c91e1dfe74 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:22.009416 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-8a5d7cdf-3fa6-420d-9e35-455e52742229 req-b84167cc-2785-47f7-9d98-d2c91e1dfe74 service nova] Creating event network-vif-deleted:cef004e9-2264-426f-8575-fe483632a097 for instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 on hv-cinder-83699 May 20 09:21:22.014448 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-8a5d7cdf-3fa6-420d-9e35-455e52742229 req-b84167cc-2785-47f7-9d98-d2c91e1dfe74 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 May 20 09:21:22.016008 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 485/987] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:21:22.233907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:22.234903 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:22.241443 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:22.241940 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:22.242822 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:22.243327 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:22.278089 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:22.278471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:22.288948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lazy-loading 'fault' on Instance uuid 43fcdc4c-b5f5-4ed1-819e-c916a953b508 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:21:22.325803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661271a657a548468ff85fe298e0c5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e619f7d90e8543ba85f3bbaba9046c72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:21:22.334528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f07e699e-0c4d-4570-98a5-5fc750b034a0 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 200 len: 1309 microversion: 2.1 time: 0.104513 May 20 09:21:22.335608 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 503/988] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:21:22 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:21:23.354099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:23.354650 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] [instance: 43fcdc4c-b5f5-4ed1-819e-c916a953b508] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:23.362529 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:23.363005 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:23.363860 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:23.364317 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:23.378507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] HTTP exception thrown: Instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 could not be found. May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Request method failure captured: May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 HTTP/1.1 May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih10tmMZiKJ78zuWgWUqBN0LiYhL47Di54ukS-vSXodNzAFFK1jvsl38oENDY--sR_qo_P4PmHtQFioic73qJK-VKznjM6TPjJnCPa4rofHuVa4Qek38EzohVud3nVNuCigoeZtdEHLr0Gw2HzOFJGYfuNskWyGNg9qGiK83AK-6UL1Q May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: e619f7d90e8543ba85f3bbaba9046c72 May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2128801322 May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:21:23.380372 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e619f7d90e8543ba85f3bbaba9046c72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e619f7d90e8543ba85f3bbaba9046c72", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e619f7d90e8543ba85f3bbaba9046c72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e619f7d90e8543ba85f3bbaba9046c72"}]}] May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesSnapshotTestJSON-2128801322 May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e619f7d90e8543ba85f3bbaba9046c72 May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2128801322 May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesSnapshotTestJSON-2128801322-project May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 661271a657a548468ff85fe298e0c5f9 May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesSnapshotTestJSON-2128801322-project May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 could not be found. May 20 09:21:23.381801 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '43fcdc4c-b5f5-4ed1-819e-c916a953b508'} May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 could not be found. May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:21:23.382584 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 could not be found. May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 could not be found. May 20 09:21:23.384346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:21:23.386078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] Returning 404 to user: Instance 43fcdc4c-b5f5-4ed1-819e-c916a953b508 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:21:23.386078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-365deccf-1839-4fa8-8213-8d274d701838 tempest-VolumesSnapshotTestJSON-2128801322 tempest-VolumesSnapshotTestJSON-2128801322-project] 10.222.0.69 "GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508" status: 404 len: 111 microversion: 2.1 time: 0.033326 May 20 09:21:23.386078 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 486/989] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:21:23 2022] GET /compute/v2.1/servers/43fcdc4c-b5f5-4ed1-819e-c916a953b508 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:21:58.486642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d1ce6168-c64c-46e1-ac9d-34e462dd944a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Action: 'create', calling method: .version_select at 0x7f7c8c0ac0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-296192544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3pMGAesWh7WtzS30in5dEKh0Rsk2CeCxnW05nXN4+aw6cTyVIubLDdiOIrl06gqg7Q0QgC9/LI0KNoAR9AtQDKDilNylxC+2MYCotrdp7nj+g+2Sy0Wl7n0I2EBNq/cQ=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:21:58.491556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:58.492207 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:58.505514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-d1ce6168-c64c-46e1-ac9d-34e462dd944a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Getting quotas for project aabdb72f128d4d4da1f9390e505d704b. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:21:58.509890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-d1ce6168-c64c-46e1-ac9d-34e462dd944a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Getting quotas for user 7abef7e1523046a8970d7010ae02c37e and project aabdb72f128d4d4da1f9390e505d704b. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:21:58.536366 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d1ce6168-c64c-46e1-ac9d-34e462dd944a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053433 May 20 09:21:58.537038 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 504/990] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:21:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:21:58.703171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2143913618", "imageRef": "9b26dc02-0797-4bee-960f-cdb49904adb8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-296192544", "networks": [{"uuid": "bbafa734-b707-4f6b-9ede-9a82c40e53f6"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:21:58.710200 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=8 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:58.710833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:21:58.755437 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] validate_networks() for [('bbafa734-b707-4f6b-9ede-9a82c40e53f6', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:21:59.147828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:21:59.148434 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:21:59.149157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:21:59.149707 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:21:59.150286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:21:59.162300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:59.162750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:59.163572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:21:59.164002 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:21:59.183825 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Getting quotas for project aabdb72f128d4d4da1f9390e505d704b. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:21:59.190379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Getting quotas for user 7abef7e1523046a8970d7010ae02c37e and project aabdb72f128d4d4da1f9390e505d704b. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:21:59.205251 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:21:59.207494 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b26dc02-0797-4bee-960f-cdb49904adb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:21:59.255982 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-03f4a83d-6b14-4575-a001-3e372752b1fb tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556726 May 20 09:21:59.256997 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 487/991] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:21:59.267615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4ef6406a-1344-4dc2-a371-3836b9c617f3 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:21:59.268234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4ef6406a-1344-4dc2-a371-3836b9c617f3 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:21:59.322516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4ef6406a-1344-4dc2-a371-3836b9c617f3 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:21:59.329669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4ef6406a-1344-4dc2-a371-3836b9c617f3 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1258 microversion: 2.1 time: 0.066476 May 20 09:21:59.330311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 505/992] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:21:59 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:00.347690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:00.348428 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:00.355544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:00.356774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:00.357889 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:00.358541 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:00.423192 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:00.430824 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f214c639-2a3c-4573-b228-49619b7fcd6a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1310 microversion: 2.1 time: 0.088754 May 20 09:22:00.431411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 488/993] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:00 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:01.450801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:01.451550 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:01.462492 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:01.463311 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:01.464415 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:01.464885 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:01.664378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:01.673060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-979ac538-22d3-4310-9855-474d7284b0ab tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.227514 May 20 09:22:01.683583 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 506/994] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:01 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:02.690168 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:02.690767 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:02.697579 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:02.698028 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:02.698795 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:02.699230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:02.856326 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:02.864048 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a2445860-05ab-48a0-983c-11e046803b02 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.177838 May 20 09:22:02.864612 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 489/995] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:02 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:03.881131 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:03.881826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:03.889775 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:03.890260 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:03.891061 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:03.891561 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:04.020845 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-516044067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-276577009", "security_groups": [{"name": "tempest-secgroup-smoke-447532997"}], "block_device_mapping_v2": [{"uuid": "2335e9c3-9547-4866-ba72-f03d98f8ac8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5f48dba5-6c8f-4717-93d6-9f60508a64db"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:04.034900 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:04.042627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-371f7982-cbf1-4930-b4ab-832a1848b950 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.165520 May 20 09:22:04.043281 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 507/996] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:03 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:04.148382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] validate_networks() for [('5f48dba5-6c8f-4717-93d6-9f60508a64db', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:22:04.539808 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:22:04.540223 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:22:04.540703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:22:04.541109 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:22:04.541516 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:22:04.551438 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:04.552262 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:04.553295 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:04.553968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:04.570868 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for project f26ac8782fe0407cb6f146ba70e74246. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:22:04.574898 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Getting quotas for user bc0307909d614a1f97f006dc6d091cd4 and project f26ac8782fe0407cb6f146ba70e74246. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:22:04.637132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:22:04.639602 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2335e9c3-9547-4866-ba72-f03d98f8ac8b',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:22:04.806166 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-083837a7-0b04-46cc-8506-4156415696a1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789099 May 20 09:22:04.806694 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 490/997] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:22:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:22:04.816661 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c66cbb51-ece4-4f4c-91d4-3c86fc240926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:04.817270 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c66cbb51-ece4-4f4c-91d4-3c86fc240926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:04.878958 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c66cbb51-ece4-4f4c-91d4-3c86fc240926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:04.887496 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c66cbb51-ece4-4f4c-91d4-3c86fc240926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1093 microversion: 2.1 time: 0.074532 May 20 09:22:04.893710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 508/998] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:04 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:05.061596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:05.062268 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:05.084662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:05.085528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:05.086272 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:05.086846 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:05.346214 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:05.356063 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-035000f3-4ee6-4163-8b07-d65236f6dbac tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.298872 May 20 09:22:05.367182 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 491/999] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:05 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:05.905957 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:05.906559 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:05.914195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:05.914642 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:05.915428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:05.915856 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:05.977082 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:05.984655 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-88e68d85-f011-4211-80e1-968016dca58d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1143 microversion: 2.1 time: 0.082854 May 20 09:22:05.985208 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 509/1000] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:05 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:06.374150 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:06.374895 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:06.381688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:06.382131 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:06.382919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:06.383390 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:06.524450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:06.532073 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1958570e-5aa2-4cc0-b8d0-32c4e7bf762c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.162048 May 20 09:22:06.532640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 492/1001] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:06 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:07.006576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:07.007190 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:07.014489 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:07.014931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:07.015725 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:07.016149 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:07.084247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:07.092788 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cd65b664-17c0-4fd2-8785-e8752acd6d83 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1143 microversion: 2.1 time: 0.090075 May 20 09:22:07.093412 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 510/1002] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:07 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:07.550554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:07.551170 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:07.558238 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:07.558679 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:07.559478 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:07.559894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:07.705179 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:07.714115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c3204095-50ea-4c36-976f-719dcdba00d7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.168011 May 20 09:22:07.715040 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 493/1003] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:07 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:08.110028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:08.110688 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:08.117366 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:08.117806 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:08.118546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:08.118974 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:08.198344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:08.206138 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-37faf32c-0810-44f0-b274-f61a05c5686d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1143 microversion: 2.1 time: 0.100004 May 20 09:22:08.206711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 511/1004] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:08 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1143 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:08.731890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:08.732839 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:08.740507 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:08.741367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:08.742297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:08.742924 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:08.877790 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:08.885751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c7705361-1aeb-4294-8aa7-28143363cfb4 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.158437 May 20 09:22:08.886316 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 494/1005] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:08 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:09.227422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:09.228405 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:09.236354 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:09.236801 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:09.237582 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:09.238001 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:09.301611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:09.309312 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c764cb26-244d-4b8e-af10-de9ab5fa9e34 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1143 microversion: 2.1 time: 0.088408 May 20 09:22:09.309874 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 512/1006] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:09 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:09.903577 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:09.904167 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:09.911010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:09.911465 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:09.912258 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:09.912688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:10.049336 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:10.058230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b7d6bed0-7078-4d5e-bfc6-0caaefbb9456 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.158724 May 20 09:22:10.059411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 495/1007] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:09 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:10.311787 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8ac5ce09-3528-4f94-91d4-e0e843b397eb req-f1634d71-16f0-4cac-abc5-265a5fd6317c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:10.324438 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8ac5ce09-3528-4f94-91d4-e0e843b397eb req-f1634d71-16f0-4cac-abc5-265a5fd6317c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:10.324964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8ac5ce09-3528-4f94-91d4-e0e843b397eb req-f1634d71-16f0-4cac-abc5-265a5fd6317c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:10.326661 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:10.327382 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:10.338919 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:10.339173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8ac5ce09-3528-4f94-91d4-e0e843b397eb req-f1634d71-16f0-4cac-abc5-265a5fd6317c service nova] Creating event network-changed:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:22:10.343150 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:10.344690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:10.345627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:10.345804 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8ac5ce09-3528-4f94-91d4-e0e843b397eb req-f1634d71-16f0-4cac-abc5-265a5fd6317c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039617 May 20 09:22:10.346785 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 513/1008] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:10.474787 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:10.485115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a0f6530-094b-4a74-b8f4-6c06912348b4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1191 microversion: 2.1 time: 0.162916 May 20 09:22:10.488286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 496/1009] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:10 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:10.637426 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:22:10.637693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Fri May 20 09:22:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:22:11.082983 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:11.084164 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:11.093102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:11.093560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:11.094328 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:11.094765 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:11.282586 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:11.290540 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-99e91230-e512-4683-af93-24393164562d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.214883 May 20 09:22:11.291113 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 514/1010] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:11 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:11.507783 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:11.508780 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:11.517424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:11.517877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:11.518637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:11.519069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:11.609681 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:11.617922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0d64a799-92b5-436d-b2cd-c68cd76c2c47 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1209 microversion: 2.1 time: 0.116693 May 20 09:22:11.618968 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 497/1011] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:11 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:12.307048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:12.307666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:12.314420 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:12.314873 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:12.315667 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:12.316085 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:12.459688 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:12.467883 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-827baa21-7688-4750-9adf-eabbb9ec6be8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.164800 May 20 09:22:12.468594 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 515/1012] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:12 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:12.636588 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:12.637239 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:12.644865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:12.645375 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:12.646099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:12.646880 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:12.858763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-b9f10153-c2c2-4484-a448-d2f80f726e21 req-fa29aa81-e5b7-4425-9800-80ef78994897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ba787b-f76a-465a-a7dd-4f1c63a69662", "tag": "e23c9026-9127-4ce1-b841-54f42ba1005c"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:12.861692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:12.870616 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-29769ea3-b52e-4d2d-8efb-1b4f3a3c5b4a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.239156 May 20 09:22:12.871222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 498/1013] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:12 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:12.875627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b9f10153-c2c2-4484-a448-d2f80f726e21 req-fa29aa81-e5b7-4425-9800-80ef78994897 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:12.876321 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b9f10153-c2c2-4484-a448-d2f80f726e21 req-fa29aa81-e5b7-4425-9800-80ef78994897 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:12.891004 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-b9f10153-c2c2-4484-a448-d2f80f726e21 req-fa29aa81-e5b7-4425-9800-80ef78994897 service nova] Creating event network-changed:e23c9026-9127-4ce1-b841-54f42ba1005c for instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 on hv-cinder-83699 May 20 09:22:12.897167 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-b9f10153-c2c2-4484-a448-d2f80f726e21 req-fa29aa81-e5b7-4425-9800-80ef78994897 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044519 May 20 09:22:12.897864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 516/1014] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:13.485544 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:13.486222 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:13.492908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:13.493350 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:13.494112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:13.494539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:13.717776 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:13.725852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-57f9d1e5-02d6-45db-be37-af35935a03b1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.244383 May 20 09:22:13.726408 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 499/1015] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:13 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:13.888410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:13.889446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:13.896451 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:13.896887 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:13.897639 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:13.898068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:14.026848 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:14.034555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7ac6a2b2-f592-4ad8-832f-e73920417a04 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.150441 May 20 09:22:14.035099 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 517/1016] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:13 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:14.746969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:14.747723 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:14.750034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:14.750816 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=12 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:14.758716 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:14.759304 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:14.760229 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:14.760775 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:14.896205 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:14.904105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-592c1f08-c5f1-48df-af88-44b3436aed83 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.163588 May 20 09:22:14.904665 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 500/1017] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:14 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:15.055753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:15.056559 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:15.060911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=8 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:15.070606 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:15.071378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:15.072630 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:15.073452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:15.214845 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:15.222906 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4a9c7519-d48f-4724-8bf0-859d33ac54be tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.173705 May 20 09:22:15.223526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 518/1018] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:15 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:15.923567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:15.924393 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:15.932985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:15.933592 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:15.934614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:15.935204 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:16.079690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:16.087633 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f879a045-e6a8-4d5d-b572-20bab5c1cbe8 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.169869 May 20 09:22:16.088245 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 501/1019] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:15 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:16.242256 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:16.242849 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:16.249749 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:16.250197 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:16.250977 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:16.251422 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:16.251842 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-0ee41c60-e756-4c2f-887e-f063dc8d155a req-20bae845-3770-48e7-b656-356c40408b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "name": "network-vif-plugged", "status": "completed", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:16.261833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-0ee41c60-e756-4c2f-887e-f063dc8d155a req-20bae845-3770-48e7-b656-356c40408b45 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:16.262373 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-0ee41c60-e756-4c2f-887e-f063dc8d155a req-20bae845-3770-48e7-b656-356c40408b45 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:16.275099 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-0ee41c60-e756-4c2f-887e-f063dc8d155a req-20bae845-3770-48e7-b656-356c40408b45 service nova] Creating event network-vif-plugged:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:22:16.280688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-0ee41c60-e756-4c2f-887e-f063dc8d155a req-20bae845-3770-48e7-b656-356c40408b45 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032875 May 20 09:22:16.281379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 502/1020] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:16.392359 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:16.399905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3f8a5068-b467-4301-aa80-04f9fdf24cc3 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.161532 May 20 09:22:16.400470 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 519/1021] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:16 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:17.109849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:17.110995 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:17.125283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:17.125733 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:17.126543 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:17.126972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:17.255603 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:17.263704 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-32fe7122-2bbd-4f47-9e5a-5fa173c8c13d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1358 microversion: 2.1 time: 0.161634 May 20 09:22:17.264632 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 503/1022] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:17 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:17.422350 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:17.423055 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:17.433580 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:17.434146 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:17.435228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:17.435838 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:17.572777 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:17.582145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-09635b43-6f15-48ad-9e85-9fca7837d061 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.167609 May 20 09:22:17.583033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 520/1023] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:17 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:18.290655 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:18.291717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:18.302939 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.303763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.305020 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.305740 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.444902 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:18.455012 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-658493f9-c8f4-495b-a24c-20a338de167a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1549 microversion: 2.1 time: 0.170898 May 20 09:22:18.455648 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 504/1024] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:18 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:18.479649 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:18.480200 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:18.487122 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.487664 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.488427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.488853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.602953 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:18.603598 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:18.609855 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.610305 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.611064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.611532 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.623837 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:18.629727 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:18.631681 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-00a5301f-6cc4-4a87-84d3-c58b26302017 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1549 microversion: 2.1 time: 0.156069 May 20 09:22:18.632229 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 521/1025] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:18 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:18.647650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:18.650981 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:18.651783 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Searching by: {'deleted': False, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b'} {{(pid=117980) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 20 09:22:18.658763 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.659199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.660012 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.660463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.744745 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:18.748179 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.multi_cell_list [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117980) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 20 09:22:18.752520 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0d942748-92f0-4b8e-afa5-9cbbc12e278f tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.153513 May 20 09:22:18.753203 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 505/1026] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:18 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:22:18.842537 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3e5d7793-2d50-4e27-bfa2-fac8d6877351 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198396 May 20 09:22:18.843058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 522/1027] 10.222.0.69 () {58 vars in 1124 bytes} [Fri May 20 09:22:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:18.859140 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:18.859836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:18.866023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.866477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.867236 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:18.867793 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:18.999763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:19.007848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-990ce5e3-202c-4979-b0ac-d158c06c4b99 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1549 microversion: 2.1 time: 0.155019 May 20 09:22:19.008425 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 506/1028] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:18 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:19.769727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:19.770333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:19.777299 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:19.777745 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:19.778511 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:19.778942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:19.913204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:19.924535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b97b19bb-7b15-4405-b3a5-71c997d1e926 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.158544 May 20 09:22:19.925176 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 523/1029] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:19 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:20.544065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:20.545132 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:20.552117 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:20.552580 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:20.553332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:20.553756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:20.824572 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4ba561f8-0774-433d-88ec-7c693727ceec tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284193 May 20 09:22:20.825176 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 507/1030] 10.222.0.69 () {60 vars in 1322 bytes} [Fri May 20 09:22:20 2022] POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:20.941479 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:20.942098 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:20.948711 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:20.949166 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:20.949926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:20.950357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:20.970187 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:21.086753 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:21.094840 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b39a9996-1555-498a-8a19-7a822466d805 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.157455 May 20 09:22:21.095462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 524/1031] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:20 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:22.118286 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:22.119609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:22.128929 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:22.129349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:22.130111 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:22.130533 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:22.266848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:22.274206 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-aed0e52e-74c2-40bb-9374-b3d9633eb9f4 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.164034 May 20 09:22:22.275064 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 508/1032] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:22 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:23.294817 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:23.295858 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:23.303803 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:23.304247 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:23.305000 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:23.305430 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:23.435214 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:23.443922 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ed804eac-210c-4547-b2b1-5ada364aa85a tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.155695 May 20 09:22:23.444463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 525/1033] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:23 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:24.289809 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-79f1dc64-0419-4cd2-8f3e-9a4867c1b269 req-d5e7b653-f1fb-4bab-b8ad-624bba588e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ba787b-f76a-465a-a7dd-4f1c63a69662", "name": "network-vif-plugged", "status": "completed", "tag": "e23c9026-9127-4ce1-b841-54f42ba1005c"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:24.298634 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-79f1dc64-0419-4cd2-8f3e-9a4867c1b269 req-d5e7b653-f1fb-4bab-b8ad-624bba588e0f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:24.299100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-79f1dc64-0419-4cd2-8f3e-9a4867c1b269 req-d5e7b653-f1fb-4bab-b8ad-624bba588e0f service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:24.310441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-79f1dc64-0419-4cd2-8f3e-9a4867c1b269 req-d5e7b653-f1fb-4bab-b8ad-624bba588e0f service nova] Creating event network-vif-plugged:e23c9026-9127-4ce1-b841-54f42ba1005c for instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 on hv-cinder-83699 May 20 09:22:24.315391 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-79f1dc64-0419-4cd2-8f3e-9a4867c1b269 req-d5e7b653-f1fb-4bab-b8ad-624bba588e0f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029317 May 20 09:22:24.315987 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 509/1034] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:24.462081 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:24.462699 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:24.469553 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:24.470000 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:24.475864 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:24.476333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:24.606352 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:24.614029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2bf951d7-4dbf-4f4d-89c4-5fe8018f50f1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1264 microversion: 2.1 time: 0.156540 May 20 09:22:24.614609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 526/1035] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:24 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:25.631953 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:25.632659 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:25.639865 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:25.640314 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:25.641089 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:25.641528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:25.785803 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:25.793528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f471100e-44e6-4caa-b084-f76b5c383af8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1452 microversion: 2.1 time: 0.166519 May 20 09:22:25.794101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 510/1036] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:25 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:25.814893 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:25.815566 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:25.822418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:25.823119 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:25.823952 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:25.824377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:25.959576 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:25.967354 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ca02b335-876e-4940-9d80-833f475c4363 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1452 microversion: 2.1 time: 0.156447 May 20 09:22:25.967929 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 527/1037] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:25 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:22:27.378663 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:27.379943 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:27.386658 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:27.387142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:27.388007 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:27.388439 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:27.890034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:27.898785 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e6f37d4e-58ab-4a33-9456-103d2460e837 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1595 microversion: 2.1 time: 0.524092 May 20 09:22:27.899380 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 511/1038] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:27 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1595 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:28.199545 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-b829dc2e-22ed-469b-a4b9-62e5d343d583 req-18e5e97d-87f4-4bb6-9fa7-8870ac33c743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ba787b-f76a-465a-a7dd-4f1c63a69662", "tag": "e23c9026-9127-4ce1-b841-54f42ba1005c"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:28.208599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b829dc2e-22ed-469b-a4b9-62e5d343d583 req-18e5e97d-87f4-4bb6-9fa7-8870ac33c743 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:28.208599 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b829dc2e-22ed-469b-a4b9-62e5d343d583 req-18e5e97d-87f4-4bb6-9fa7-8870ac33c743 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:28.222465 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-b829dc2e-22ed-469b-a4b9-62e5d343d583 req-18e5e97d-87f4-4bb6-9fa7-8870ac33c743 service nova] Creating event network-changed:e23c9026-9127-4ce1-b841-54f42ba1005c for instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 on hv-cinder-83699 May 20 09:22:28.227486 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-b829dc2e-22ed-469b-a4b9-62e5d343d583 req-18e5e97d-87f4-4bb6-9fa7-8870ac33c743 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031633 May 20 09:22:28.231026 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 528/1039] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:29.954493 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6e947cee-0f61-4306-a13f-96fa2b40c6e4 req-ffe48242-3b93-4d22-abc2-c62038a747c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:29.959058 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:29.967006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6e947cee-0f61-4306-a13f-96fa2b40c6e4 req-ffe48242-3b93-4d22-abc2-c62038a747c2 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:29.967558 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6e947cee-0f61-4306-a13f-96fa2b40c6e4 req-ffe48242-3b93-4d22-abc2-c62038a747c2 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:29.980903 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6e947cee-0f61-4306-a13f-96fa2b40c6e4 req-ffe48242-3b93-4d22-abc2-c62038a747c2 service nova] Creating event network-changed:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:22:29.986202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6e947cee-0f61-4306-a13f-96fa2b40c6e4 req-ffe48242-3b93-4d22-abc2-c62038a747c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 May 20 09:22:29.986932 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 512/1040] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:31.067620 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:31.072546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1610335538"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:31.073159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:31.074933 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:31.080624 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:31.081064 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:31.081859 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:31.082279 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:31.213100 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.network.security_group_api [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Adding security group 500b66a3-308a-4182-9ae7-60ba86c90d84 to port 63903daa-30be-49a0-b1aa-1178cef36497 May 20 09:22:31.627249 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e6bc55af-b6e8-42a7-bc2c-9cc42b796887 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.560463 May 20 09:22:31.628117 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 529/1041] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:22:31 2022] POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:22:31.637992 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:31.638802 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:31.646039 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:31.646515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:31.647309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:31.647747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:31.812528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:31.821595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9a9e4c13-2353-4557-8ec6-77a33f65090c tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1761 microversion: 2.1 time: 0.188597 May 20 09:22:31.822204 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 513/1042] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:31 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1761 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:32.001996 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-31d2ba0a-a222-4e73-ac63-b143e4b21c4c req-b6cbf213-45fc-482b-b609-d44c01a95241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:32.011228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-31d2ba0a-a222-4e73-ac63-b143e4b21c4c req-b6cbf213-45fc-482b-b609-d44c01a95241 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:32.011788 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-31d2ba0a-a222-4e73-ac63-b143e4b21c4c req-b6cbf213-45fc-482b-b609-d44c01a95241 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:32.023668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-31d2ba0a-a222-4e73-ac63-b143e4b21c4c req-b6cbf213-45fc-482b-b609-d44c01a95241 service nova] Creating event network-changed:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:22:32.028825 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-31d2ba0a-a222-4e73-ac63-b143e4b21c4c req-b6cbf213-45fc-482b-b609-d44c01a95241 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030547 May 20 09:22:32.029408 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 530/1043] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:22:54.150433 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:22:54.151563 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:54.155042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:54.156017 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:54.165215 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:54.165672 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:54.166774 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:54.167457 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:54.254344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f2f6b5bb-e3aa-430c-bfa4-8b6a0de48944 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.110051 May 20 09:22:54.255240 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 514/1044] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:22:54 2022] POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:22:54.262546 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:54.263386 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=28 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:22:54.268251 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:54.268950 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:54.276374 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:54.276890 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:54.277676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:54.278151 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:54.441483 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:54.449926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-20db6136-1820-43fd-bfa0-95ef9071e154 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1753 microversion: 2.1 time: 0.189762 May 20 09:22:54.450528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 531/1045] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:54 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:55.472755 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:55.473715 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:55.483208 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:55.483690 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:55.484443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:55.484866 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:55.641684 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:55.652689 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f58d7256-e4e9-4153-8d18-d497049433f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.187808 May 20 09:22:55.653413 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 515/1046] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:55 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:56.679931 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:56.680668 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:56.688609 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:56.689053 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:56.689800 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:56.690228 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:56.847710 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:56.856802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f613bc27-9ffd-405a-b787-5bfca5453b65 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.183013 May 20 09:22:56.857807 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 532/1047] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:56 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:57.883379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:57.884385 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:57.893450 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:57.893890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:57.894643 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:57.895061 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:58.056167 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:58.065596 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-acd354bf-e9de-4848-960d-9c37878c491a tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.188790 May 20 09:22:58.066186 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 516/1048] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:57 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:22:59.086548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:22:59.087616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:22:59.096440 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:59.096889 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:59.097687 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:22:59.098118 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:22:59.245826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:22:59.257427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-14375568-0643-475f-9a44-50d31d16460f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.177428 May 20 09:22:59.258145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 533/1049] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:22:59 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:00.281074 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:00.281896 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:00.289738 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:00.290259 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:00.291133 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:00.291671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:00.449330 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:00.462319 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8b249c10-71e8-4ec9-9d08-5ffddb95902f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.187051 May 20 09:23:00.463183 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 517/1050] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:00 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:01.488644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:01.489333 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:01.497852 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:01.498446 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:01.499512 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:01.500087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:01.658241 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:01.666515 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-70ca7d9c-c0e0-482d-80f5-c6e405e9bff1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.183674 May 20 09:23:01.667083 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 534/1051] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:01 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:02.686748 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:02.687446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:02.695079 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:02.695550 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:02.696297 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:02.696722 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:02.843852 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:02.852523 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d019d509-eeb6-4eb5-a04c-c2d5ed222fb0 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.171856 May 20 09:23:02.853096 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 518/1052] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:02 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:03.873942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:03.874955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:03.885911 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:03.886650 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:03.887947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:03.889053 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:04.055358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:04.063553 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-efc35eaa-5f88-46b1-b1d3-0145dc6f7821 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.196065 May 20 09:23:04.064104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 535/1053] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:03 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:05.084181 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:05.084724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:05.091986 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:05.092441 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:05.093212 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:05.094404 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:05.248164 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:05.261093 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-161b6cac-d724-4cb7-acec-4b617c269411 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1758 microversion: 2.1 time: 0.181421 May 20 09:23:05.261735 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 519/1054] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:05 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:06.282219 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:06.283531 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:06.290591 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:06.291031 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:06.291812 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:06.292234 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:06.433781 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:06.444396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f3afb6c9-14e8-4595-93b5-33335c6088df tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1761 microversion: 2.1 time: 0.168624 May 20 09:23:06.444975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 536/1055] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:06 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:39.033200 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1610335538"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:23:39.034174 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:39.037705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=12 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:39.038763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:39.048877 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:39.049342 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:39.050112 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:39.050532 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:39.302159 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.network.security_group_api [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Removing security group 500b66a3-308a-4182-9ae7-60ba86c90d84 from port 63903daa-30be-49a0-b1aa-1178cef36497 May 20 09:23:39.695131 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b4b1c381-a6b5-4bec-a8f2-7fe2cfcd42f2 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.668145 May 20 09:23:39.696090 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 520/1056] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:23:39 2022] POST /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:23:39.701756 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-4746b049-f0ae-492d-9e16-b268bf7229bd req-1313bd95-b13d-4311-8dd7-0746e406a106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:23:39.719071 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=12 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:39.720917 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=36 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:39.743192 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4746b049-f0ae-492d-9e16-b268bf7229bd req-1313bd95-b13d-4311-8dd7-0746e406a106 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:39.744110 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4746b049-f0ae-492d-9e16-b268bf7229bd req-1313bd95-b13d-4311-8dd7-0746e406a106 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:39.762729 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-4746b049-f0ae-492d-9e16-b268bf7229bd req-1313bd95-b13d-4311-8dd7-0746e406a106 service nova] Creating event network-changed:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:23:39.778326 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-4746b049-f0ae-492d-9e16-b268bf7229bd req-1313bd95-b13d-4311-8dd7-0746e406a106 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080108 May 20 09:23:39.782497 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 537/1057] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:23:41.360101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:41.360654 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:41.366942 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:41.367420 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:41.368189 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:41.368607 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:41.454477 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lazy-loading 'services' on Instance uuid ce95e8ad-c22a-414c-a60f-b09d90de6ca5 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:23:41.532985 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3dcebc24-68c0-4fe6-a09d-425c091d6ea1 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments/2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa" status: 202 len: 0 microversion: 2.1 time: 0.177457 May 20 09:23:41.533577 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 521/1058] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:23:41 2022] DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments/2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:23:41.547355 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:41.548631 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:41.557523 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:41.557965 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:41.558881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:41.559332 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:41.599974 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32210335-4cd6-462f-a7a8-d6cc094c5e76 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057111 May 20 09:23:41.604195 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 538/1059] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:23:41 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:23:41.796564 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-dfc5fce8-1630-4664-ac47-ed83417f9657 req-0980245c-934a-4ff8-bf63-5022ff9be9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:23:41.805134 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-dfc5fce8-1630-4664-ac47-ed83417f9657 req-0980245c-934a-4ff8-bf63-5022ff9be9a6 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:41.805594 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-dfc5fce8-1630-4664-ac47-ed83417f9657 req-0980245c-934a-4ff8-bf63-5022ff9be9a6 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:41.817092 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-dfc5fce8-1630-4664-ac47-ed83417f9657 req-0980245c-934a-4ff8-bf63-5022ff9be9a6 service nova] Creating event network-changed:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:23:41.822702 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-dfc5fce8-1630-4664-ac47-ed83417f9657 req-0980245c-934a-4ff8-bf63-5022ff9be9a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032087 May 20 09:23:41.823686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 522/1060] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:23:42.614510 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:42.615526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:42.622452 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:42.622894 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:42.623675 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:42.624097 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:42.653272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1fcc5ebb-7d09-401f-8f2d-238c5eee3c27 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043594 May 20 09:23:42.653819 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 539/1061] 10.222.0.69 () {58 vars in 1301 bytes} [Fri May 20 09:23:42 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 20 09:23:42.668906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:42.669463 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:42.677351 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:42.677786 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:42.678522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:42.678973 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:42.755876 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] HTTP exception thrown: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 is not attached to volume 2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Request method failure captured: May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments/2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa HTTP/1.1 May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih12mJMJGVZnnmZyNoZuk1i4Um-Vl3KaUWAJv3-37pz3mOfU3adf-GZymkPKQ37QeyivDwiwQ7k9_8AuYtBOGWjmYckNET7vwsfarTHXP32fK-Ai_9w8fcR00pGCfW1x8o_aT9cBmCay7BDyVRvliV3ZikQjP66pawGs5QqKp9foh7Ys May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: aabdb72f128d4d4da1f9390e505d704b May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestMinimumBasicScenario-1121316129 May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:23:42.760449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aabdb72f128d4d4da1f9390e505d704b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aabdb72f128d4d4da1f9390e505d704b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aabdb72f128d4d4da1f9390e505d704b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aabdb72f128d4d4da1f9390e505d704b"}]}] May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestMinimumBasicScenario-1121316129 May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: aabdb72f128d4d4da1f9390e505d704b May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1121316129 May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestMinimumBasicScenario-1121316129-project May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 7abef7e1523046a8970d7010ae02c37e May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestMinimumBasicScenario-1121316129-project May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:23:42.762100 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 is not attached to volume 2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'server_id': 'ce95e8ad-c22a-414c-a60f-b09d90de6ca5', 'id': '2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa'} May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa. May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:23:42.762999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 is not attached to volume 2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 is not attached to volume 2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:42.765019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Returning 404 to user: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 is not attached to volume 2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:23:42.766426 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-539d20d5-6a46-482a-ba03-7abd23cde67e tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments/2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa" status: 404 len: 154 microversion: 2.1 time: 0.101061 May 20 09:23:42.766426 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 523/1062] 10.222.0.69 () {58 vars in 1415 bytes} [Fri May 20 09:23:42 2022] DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5/os-volume_attachments/2df81ca8-eed7-47ba-bfd8-35cd0bcce4aa => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:23:43.920412 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:43.920932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:43.930560 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:43.931181 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:43.932380 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:43.933013 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:43.959140 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:23:44.038570 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e82ea19c-cb79-42b8-ad20-308d88a83bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 204 len: 0 microversion: 2.1 time: 0.124109 May 20 09:23:44.039163 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 540/1063] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:23:43 2022] DELETE /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:23:44.047622 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:44.048249 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:44.055179 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:44.055662 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:44.056424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:44.056856 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:44.189398 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:44.197146 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d6700fba-3f36-42e1-9b7a-85c6c9b1155f tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1555 microversion: 2.1 time: 0.153498 May 20 09:23:44.197700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 524/1064] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:44 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 20 09:23:45.215600 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:45.216377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:45.224048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:45.224526 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:45.225285 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:45.225713 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:45.415964 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:45.427720 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4684b90f-2110-4c9e-8085-b99c67223ba7 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1555 microversion: 2.1 time: 0.216690 May 20 09:23:45.428552 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 541/1065] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:45 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:46.202137 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b616fca4-009e-47d6-82b7-a0cd27f8a4c6 req-b7fe6c7a-3fcc-4f93-975f-c0c6ab828546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce95e8ad-c22a-414c-a60f-b09d90de6ca5", "name": "network-vif-deleted", "tag": "63903daa-30be-49a0-b1aa-1178cef36497"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:23:46.210567 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b616fca4-009e-47d6-82b7-a0cd27f8a4c6 req-b7fe6c7a-3fcc-4f93-975f-c0c6ab828546 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:46.210999 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b616fca4-009e-47d6-82b7-a0cd27f8a4c6 req-b7fe6c7a-3fcc-4f93-975f-c0c6ab828546 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:46.224849 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b616fca4-009e-47d6-82b7-a0cd27f8a4c6 req-b7fe6c7a-3fcc-4f93-975f-c0c6ab828546 service nova] Creating event network-vif-deleted:63903daa-30be-49a0-b1aa-1178cef36497 for instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 on hv-cinder-83699 May 20 09:23:46.230038 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b616fca4-009e-47d6-82b7-a0cd27f8a4c6 req-b7fe6c7a-3fcc-4f93-975f-c0c6ab828546 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 May 20 09:23:46.230626 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 525/1066] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:23:46.453834 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:46.454708 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:46.462161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:46.462619 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:46.463410 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:46.463814 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:46.496240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:46.496679 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:46.497153 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lazy-loading 'fault' on Instance uuid ce95e8ad-c22a-414c-a60f-b09d90de6ca5 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:23:46.543124 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7abef7e1523046a8970d7010ae02c37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabdb72f128d4d4da1f9390e505d704b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:46.552087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fe614372-2405-407c-9bb7-02c8fc96fc12 tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 200 len: 1348 microversion: 2.1 time: 0.104822 May 20 09:23:46.552677 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 542/1067] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:46 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:47.575302 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:47.576483 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] [instance: ce95e8ad-c22a-414c-a60f-b09d90de6ca5] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:47.587219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:47.588015 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:47.589275 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:47.590002 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:47.606356 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] HTTP exception thrown: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 could not be found. May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Request method failure captured: May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 HTTP/1.1 May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih12mJMJGVZnnmZyNoZuk1i4Um-Vl3KaUWAJv3-37pz3mOfU3adf-GZymkPKQ37QeyivDwiwQ7k9_8AuYtBOGWjmYckNET7vwsfarTHXP32fK-Ai_9w8fcR00pGCfW1x8o_aT9cBmCay7BDyVRvliV3ZikQjP66pawGs5QqKp9foh7Ys May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: aabdb72f128d4d4da1f9390e505d704b May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestMinimumBasicScenario-1121316129 May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:23:47.608010 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aabdb72f128d4d4da1f9390e505d704b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aabdb72f128d4d4da1f9390e505d704b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aabdb72f128d4d4da1f9390e505d704b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aabdb72f128d4d4da1f9390e505d704b"}]}] May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestMinimumBasicScenario-1121316129 May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: aabdb72f128d4d4da1f9390e505d704b May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1121316129 May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestMinimumBasicScenario-1121316129-project May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: 7abef7e1523046a8970d7010ae02c37e May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestMinimumBasicScenario-1121316129-project May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 could not be found. May 20 09:23:47.609537 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'ce95e8ad-c22a-414c-a60f-b09d90de6ca5'} May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 could not be found. May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:23:47.610452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 could not be found. May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 could not be found. May 20 09:23:47.612065 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:23:47.613703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Returning 404 to user: Instance ce95e8ad-c22a-414c-a60f-b09d90de6ca5 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:23:47.613703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f7d0f370-8611-4915-ac76-60cd6c281d5d tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5" status: 404 len: 111 microversion: 2.1 time: 0.042033 May 20 09:23:47.613703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 526/1068] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:47 2022] GET /compute/v2.1/servers/ce95e8ad-c22a-414c-a60f-b09d90de6ca5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:23:47.618173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-23992eac-a9e8-4d69-bbd3-89cfabdf6bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] Calling method '.version_select at 0x7f7c9083cd30>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:47.640168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-23992eac-a9e8-4d69-bbd3-89cfabdf6bfa tempest-TestMinimumBasicScenario-1121316129 tempest-TestMinimumBasicScenario-1121316129-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-296192544" status: 202 len: 0 microversion: 2.1 time: 0.025582 May 20 09:23:47.640895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 543/1069] 10.222.0.69 () {58 vars in 1268 bytes} [Fri May 20 09:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-296192544 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:23:57.957777 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:57.958283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:57.961072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=14 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:57.961742 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:57.970008 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:57.971243 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:23:57.971411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:57.971814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:57.972600 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:57.973034 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:58.004775 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:23:58.140602 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-1b24aee2-6418-42e2-90aa-644a6fe82e7f req-55a5e661-ea7c-467e-9972-de24501132b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ba787b-f76a-465a-a7dd-4f1c63a69662", "tag": "e23c9026-9127-4ce1-b841-54f42ba1005c"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:23:58.143614 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6c0638e4-22b4-4d3b-a35d-d84e4ba2f362 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 204 len: 0 microversion: 2.1 time: 0.189263 May 20 09:23:58.147250 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 527/1070] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:23:57 2022] DELETE /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:23:58.156495 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:58.157393 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:58.161428 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-1b24aee2-6418-42e2-90aa-644a6fe82e7f req-55a5e661-ea7c-467e-9972-de24501132b9 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:58.162233 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-1b24aee2-6418-42e2-90aa-644a6fe82e7f req-55a5e661-ea7c-467e-9972-de24501132b9 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:58.167197 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:58.168204 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:58.169189 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:58.169688 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:58.181028 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-1b24aee2-6418-42e2-90aa-644a6fe82e7f req-55a5e661-ea7c-467e-9972-de24501132b9 service nova] Creating event network-changed:e23c9026-9127-4ce1-b841-54f42ba1005c for instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 on hv-cinder-83699 May 20 09:23:58.189805 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-1b24aee2-6418-42e2-90aa-644a6fe82e7f req-55a5e661-ea7c-467e-9972-de24501132b9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218971 May 20 09:23:58.190741 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 544/1071] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:23:58.393618 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:58.405322 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-91f93124-3a63-46ea-b114-7c440f8618a9 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1577 microversion: 2.1 time: 0.256160 May 20 09:23:58.406243 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 528/1072] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:58 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1577 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:23:59.426401 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:23:59.427115 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:23:59.437959 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:59.438471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:59.439196 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:23:59.439767 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:23:59.885648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:23:59.895462 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dd66bc7e-fee5-4d6e-bde1-287b4bfdc7d7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1577 microversion: 2.1 time: 0.474306 May 20 09:23:59.896926 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 545/1073] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:23:59 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1577 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:00.238936 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b2ac41e5-9ef4-455b-8a60-9fcac85df0aa req-463db076-ec73-4df2-a954-07768bc34ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ba787b-f76a-465a-a7dd-4f1c63a69662", "name": "network-vif-deleted", "tag": "e23c9026-9127-4ce1-b841-54f42ba1005c"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:00.268120 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b2ac41e5-9ef4-455b-8a60-9fcac85df0aa req-463db076-ec73-4df2-a954-07768bc34ac9 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:00.268783 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b2ac41e5-9ef4-455b-8a60-9fcac85df0aa req-463db076-ec73-4df2-a954-07768bc34ac9 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:00.294713 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b2ac41e5-9ef4-455b-8a60-9fcac85df0aa req-463db076-ec73-4df2-a954-07768bc34ac9 service nova] Creating event network-vif-deleted:e23c9026-9127-4ce1-b841-54f42ba1005c for instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 on hv-cinder-83699 May 20 09:24:00.300047 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b2ac41e5-9ef4-455b-8a60-9fcac85df0aa req-463db076-ec73-4df2-a954-07768bc34ac9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064733 May 20 09:24:00.301233 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 529/1074] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:24:00.919881 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:00.921882 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:00.931698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:00.932418 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:00.933790 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:00.935201 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:00.976877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:00.977323 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:00.977878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lazy-loading 'fault' on Instance uuid e2ba787b-f76a-465a-a7dd-4f1c63a69662 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:24:01.028447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:01.035797 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32d0a8b1-2218-491f-b11a-e1621cb813cb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 200 len: 1350 microversion: 2.1 time: 0.125121 May 20 09:24:01.036457 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 546/1075] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:00 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 1350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:02.055412 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:02.056115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: e2ba787b-f76a-465a-a7dd-4f1c63a69662] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:02.063529 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:02.064209 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:02.065385 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:02.065848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:02.085800 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] HTTP exception thrown: Instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 could not be found. May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Request method failure captured: May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 HTTP/1.1 May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1xlNfTd5y71egibKMT4Wu7ryYA1WVl_SkXhkxfkL_0wzD4-xU9J6HHd1ThsatdPgbr-pqn32h67XUJKgQ4DYlc1GAHj1fm8DPa3rT5snA98qEP6UAs9NtGlyE-0EA3qTueFV6AbS_pxTGaarlhiuWhU7uWXcqWUUaOdLhrepJ84IaE May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:24:02.087792 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f26ac8782fe0407cb6f146ba70e74246", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}] May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestVolumeBootPattern-297936034 May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bc0307909d614a1f97f006dc6d091cd4 May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 could not be found. May 20 09:24:02.089630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'e2ba787b-f76a-465a-a7dd-4f1c63a69662'} May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 could not be found. May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:24:02.090432 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 could not be found. May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 could not be found. May 20 09:24:02.091725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:02.094678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Returning 404 to user: Instance e2ba787b-f76a-465a-a7dd-4f1c63a69662 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:24:02.095812 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d081806c-a0fc-417d-a43f-b35b489c5fa7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662" status: 404 len: 111 microversion: 2.1 time: 0.045542 May 20 09:24:02.112024 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 530/1076] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:02 2022] GET /compute/v2.1/servers/e2ba787b-f76a-465a-a7dd-4f1c63a69662 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:24:05.963516 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:05.964303 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:05.987980 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-085a3eab-a67c-45a9-8612-f683e8675c84 req-4924e90e-fea6-4fe3-828a-8f7b5530d280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18f53dc-1246-48a4-89c6-0872683b41a6", "tag": "b5598616-768d-4048-8257-a24495be6820"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:05.994077 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:05.994648 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:05.995508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:05.998059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:06.004539 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-085a3eab-a67c-45a9-8612-f683e8675c84 req-4924e90e-fea6-4fe3-828a-8f7b5530d280 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:06.006914 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-085a3eab-a67c-45a9-8612-f683e8675c84 req-4924e90e-fea6-4fe3-828a-8f7b5530d280 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:06.029640 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-085a3eab-a67c-45a9-8612-f683e8675c84 req-4924e90e-fea6-4fe3-828a-8f7b5530d280 service nova] Creating event network-changed:b5598616-768d-4048-8257-a24495be6820 for instance f18f53dc-1246-48a4-89c6-0872683b41a6 on hv-cinder-83699 May 20 09:24:06.040822 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-085a3eab-a67c-45a9-8612-f683e8675c84 req-4924e90e-fea6-4fe3-828a-8f7b5530d280 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064898 May 20 09:24:06.057695 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 531/1077] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:24:06.074793 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:24:06.257216 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-acf5d385-1b63-4b9a-b85c-d230ff5a9cd0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 204 len: 0 microversion: 2.1 time: 0.297490 May 20 09:24:06.257924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 547/1078] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:24:05 2022] DELETE /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 20 09:24:06.266998 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:06.267854 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:06.279471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:06.279929 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:06.280709 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:06.281145 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:06.432161 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:06.440489 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aa6b63aa-ca49-46cb-8c6d-8c51baf76f1d tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1577 microversion: 2.1 time: 0.178071 May 20 09:24:06.441080 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 548/1079] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:06 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:06.475515 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1f0e3a0c-5003-4b82-b3ff-578e61e0b416 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Action: 'create', calling method: .version_select at 0x7f7c87614550>, body: {"keypair": {"name": "tempest-TestShelveInstance-772639027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJXTiZCiKtCO+Cb0vvbKs2vOt/xGDNOHErqZjYg7vdL+sum0I49g0FW7Tndft2nL+OHVNEC90/pDfuXFrdYDG3vlUBL6mn0yC64mxkeU+QAGqDOxFZ0FSaiatvEFLk/6g=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:06.491410 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-1f0e3a0c-5003-4b82-b3ff-578e61e0b416 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Getting quotas for project 0855d455651d42709d1baa57d5647015. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:24:06.496057 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-1f0e3a0c-5003-4b82-b3ff-578e61e0b416 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Getting quotas for user d753eff4043144aa930f3b1b15058fbc and project 0855d455651d42709d1baa57d5647015. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:24:06.521459 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1f0e3a0c-5003-4b82-b3ff-578e61e0b416 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.304305 May 20 09:24:06.522288 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 532/1080] 10.222.0.69 () {60 vars in 1158 bytes} [Fri May 20 09:24:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 20 09:24:07.461435 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:07.462641 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:07.473891 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:07.474344 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:07.477919 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:07.478369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:07.679657 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:07.689399 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-21407e3a-496d-4623-bf22-58232cbd90e0 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1577 microversion: 2.1 time: 0.231533 May 20 09:24:07.690942 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 549/1081] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:07 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:08.496057 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-c09c33cc-438e-49e9-873f-ce0cf3e18e52 req-2adaddeb-4174-4838-8cad-f7b2ca5345e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18f53dc-1246-48a4-89c6-0872683b41a6", "name": "network-vif-deleted", "tag": "b5598616-768d-4048-8257-a24495be6820"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:08.509424 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c09c33cc-438e-49e9-873f-ce0cf3e18e52 req-2adaddeb-4174-4838-8cad-f7b2ca5345e3 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:08.510152 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c09c33cc-438e-49e9-873f-ce0cf3e18e52 req-2adaddeb-4174-4838-8cad-f7b2ca5345e3 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:08.523189 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-c09c33cc-438e-49e9-873f-ce0cf3e18e52 req-2adaddeb-4174-4838-8cad-f7b2ca5345e3 service nova] Creating event network-vif-deleted:b5598616-768d-4048-8257-a24495be6820 for instance f18f53dc-1246-48a4-89c6-0872683b41a6 on hv-cinder-83699 May 20 09:24:08.529444 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-c09c33cc-438e-49e9-873f-ce0cf3e18e52 req-2adaddeb-4174-4838-8cad-f7b2ca5345e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038061 May 20 09:24:08.530055 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 533/1082] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:24:08.707467 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:08.708057 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:08.715202 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:08.715707 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:08.716490 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:08.716925 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:08.783607 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0307909d614a1f97f006dc6d091cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ac8782fe0407cb6f146ba70e74246', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:08.791555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5c1a4739-641c-465a-ba71-dc5110d414a7 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 200 len: 1225 microversion: 2.1 time: 0.088134 May 20 09:24:08.792343 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 550/1083] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:08 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:09.809083 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:09.809744 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: f18f53dc-1246-48a4-89c6-0872683b41a6] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:09.817756 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:09.818188 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:09.818976 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:09.819452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:09.836689 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] HTTP exception thrown: Instance f18f53dc-1246-48a4-89c6-0872683b41a6 could not be found. May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Request method failure captured: May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 HTTP/1.1 May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1xlNfTd5y71egibKMT4Wu7ryYA1WVl_SkXhkxfkL_0wzD4-xU9J6HHd1ThsatdPgbr-pqn32h67XUJKgQ4DYlc1GAHj1fm8DPa3rT5snA98qEP6UAs9NtGlyE-0EA3qTueFV6AbS_pxTGaarlhiuWhU7uWXcqWUUaOdLhrepJ84IaE May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:24:09.839178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f26ac8782fe0407cb6f146ba70e74246", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}] May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestVolumeBootPattern-297936034 May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bc0307909d614a1f97f006dc6d091cd4 May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance f18f53dc-1246-48a4-89c6-0872683b41a6 could not be found. May 20 09:24:09.840908 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': 'f18f53dc-1246-48a4-89c6-0872683b41a6'} May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f18f53dc-1246-48a4-89c6-0872683b41a6 could not be found. May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:24:09.841909 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f18f53dc-1246-48a4-89c6-0872683b41a6 could not be found. May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f18f53dc-1246-48a4-89c6-0872683b41a6 could not be found. May 20 09:24:09.843411 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:09.845041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Returning 404 to user: Instance f18f53dc-1246-48a4-89c6-0872683b41a6 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:24:09.845041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-76047f3c-6ded-4a94-bbfa-0efb4a67f4eb tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6" status: 404 len: 111 microversion: 2.1 time: 0.035848 May 20 09:24:09.845041 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 534/1084] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:09 2022] GET /compute/v2.1/servers/f18f53dc-1246-48a4-89c6-0872683b41a6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:24:10.305669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:10.306415 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:10.312947 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:10.313461 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:10.314294 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:10.314731 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:10.328463 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] HTTP exception thrown: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Request method failure captured: May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 HTTP/1.1 May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept: application/json May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Connection: close May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Length: 0 May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Content-Type: application/json May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Host: 10.222.0.69 May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABih1xlNfTd5y71egibKMT4Wu7ryYA1WVl_SkXhkxfkL_0wzD4-xU9J6HHd1ThsatdPgbr-pqn32h67XUJKgQ4DYlc1GAHj1fm8DPa3rT5snA98qEP6UAs9NtGlyE-0EA3qTueFV6AbS_pxTGaarlhiuWhU7uWXcqWUUaOdLhrepJ84IaE May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Id: None May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Domain-Name: None May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Role: member,reader May 20 09:24:10.330116 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Roles: member,reader May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f26ac8782fe0407cb6f146ba70e74246", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}] May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-TestVolumeBootPattern-297936034 May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Id: bc0307909d614a1f97f006dc6d091cd4 May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: method: > May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: exception: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.331556 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: action_args: {'id': '724e6ca0-78af-4670-a409-d2ee15ebf3d4'} May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:24:10.332345 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.333622 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi May 20 09:24:10.335072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Returning 404 to user: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:24:10.335072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-413fe400-c501-48c9-b983-e8d5b213bc57 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "DELETE /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 404 len: 111 microversion: 2.1 time: 0.029891 May 20 09:24:10.335072 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 551/1085] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:24:10 2022] DELETE /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:24:10.341001 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:10.341554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] [instance: 724e6ca0-78af-4670-a409-d2ee15ebf3d4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:10.349331 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:10.349814 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:10.350595 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:10.351045 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:10.364723 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] HTTP exception thrown: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Request method failure captured: May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 HTTP/1.1 May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih1xlNfTd5y71egibKMT4Wu7ryYA1WVl_SkXhkxfkL_0wzD4-xU9J6HHd1ThsatdPgbr-pqn32h67XUJKgQ4DYlc1GAHj1fm8DPa3rT5snA98qEP6UAs9NtGlyE-0EA3qTueFV6AbS_pxTGaarlhiuWhU7uWXcqWUUaOdLhrepJ84IaE May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:24:10.366269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f26ac8782fe0407cb6f146ba70e74246", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f26ac8782fe0407cb6f146ba70e74246"}]}] May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestVolumeBootPattern-297936034 May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: f26ac8782fe0407cb6f146ba70e74246 May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestVolumeBootPattern-297936034 May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: bc0307909d614a1f97f006dc6d091cd4 May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestVolumeBootPattern-297936034-project May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.367894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '724e6ca0-78af-4670-a409-d2ee15ebf3d4'} May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:24:10.368682 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. May 20 09:24:10.369938 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:24:10.371069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Returning 404 to user: Instance 724e6ca0-78af-4670-a409-d2ee15ebf3d4 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:24:10.371069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4cd14999-bbbf-4509-a1ef-67e964699ad8 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4" status: 404 len: 111 microversion: 2.1 time: 0.031033 May 20 09:24:10.371069 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 535/1086] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:10 2022] GET /compute/v2.1/servers/724e6ca0-78af-4670-a409-d2ee15ebf3d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:24:11.681442 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-922f45c9-82ec-49ce-8a5d-61e8874881c1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] Calling method '.version_select at 0x7f7c8c1460d0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:11.705045 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-922f45c9-82ec-49ce-8a5d-61e8874881c1 tempest-TestVolumeBootPattern-297936034 tempest-TestVolumeBootPattern-297936034-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-276577009" status: 202 len: 0 microversion: 2.1 time: 0.028472 May 20 09:24:11.706068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 552/1087] 10.222.0.69 () {58 vars in 1259 bytes} [Fri May 20 09:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-276577009 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:24:22.222546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-956850492", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-772639027", "security_groups": [{"name": "tempest-secgroup-smoke-2103521134"}], "networks": [{"uuid": "36904451-37db-4703-93e8-89780e944c9d"}], "block_device_mapping_v2": [{"uuid": "a676a865-4be0-4b9f-a1e5-7eb58b72a77c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:22.230833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:22.231724 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:22.232226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:22.342730 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] validate_networks() for [('36904451-37db-4703-93e8-89780e944c9d', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 20 09:24:22.734389 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 20 09:24:22.735050 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 20 09:24:22.735952 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 20 09:24:22.736548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 20 09:24:22.737137 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 20 09:24:22.750922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:22.751702 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:22.752947 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:22.753609 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:22.774160 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Getting quotas for project 0855d455651d42709d1baa57d5647015. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 20 09:24:22.778479 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Getting quotas for user d753eff4043144aa930f3b1b15058fbc and project 0855d455651d42709d1baa57d5647015. Resources: {'ram', 'cores', 'instances'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 20 09:24:22.836269 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 20 09:24:22.838409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a676a865-4be0-4b9f-a1e5-7eb58b72a77c',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 20 09:24:22.975732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2e4cad2f-7132-4a2e-94b2-39c6e710e702 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756988 May 20 09:24:22.976397 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 536/1088] 10.222.0.69 () {60 vars in 1146 bytes} [Fri May 20 09:24:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 20 09:24:22.986645 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bf69c2c0-cde0-48ab-ba19-5fc3978f38e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:22.987168 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bf69c2c0-cde0-48ab-ba19-5fc3978f38e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:22.989755 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:22.991394 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:23.048322 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bf69c2c0-cde0-48ab-ba19-5fc3978f38e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:23.055026 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bf69c2c0-cde0-48ab-ba19-5fc3978f38e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1087 microversion: 2.1 time: 0.072486 May 20 09:24:23.055736 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 553/1089] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:22 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:24.073123 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:24.073838 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:24.081019 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:24.081751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:24.082759 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:24.083276 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:24.153906 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:24.162045 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3033f073-5f6b-4e11-855d-18ada8978e90 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1193 microversion: 2.1 time: 0.093721 May 20 09:24:24.163004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 537/1090] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:24 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:25.180177 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:25.180727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:25.187659 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:25.188102 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:25.188853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:25.189280 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:25.408304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:25.416224 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e30f9da1-d454-4a89-9633-295aa4de6188 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.240121 May 20 09:24:25.416798 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 554/1091] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:25 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:25.556583 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-9754860c-c1ef-41d2-a12c-036284f4d5ab req-fd9388eb-ca7e-4dfc-a73f-08ff8ae6418a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:25.574241 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-9754860c-c1ef-41d2-a12c-036284f4d5ab req-fd9388eb-ca7e-4dfc-a73f-08ff8ae6418a service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:25.574887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-9754860c-c1ef-41d2-a12c-036284f4d5ab req-fd9388eb-ca7e-4dfc-a73f-08ff8ae6418a service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:25.587469 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-9754860c-c1ef-41d2-a12c-036284f4d5ab req-fd9388eb-ca7e-4dfc-a73f-08ff8ae6418a service nova] Creating event network-changed:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:24:25.592499 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-9754860c-c1ef-41d2-a12c-036284f4d5ab req-fd9388eb-ca7e-4dfc-a73f-08ff8ae6418a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040539 May 20 09:24:25.593379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 538/1092] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:24:26.432835 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:26.433407 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:26.440337 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:26.440816 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:26.441588 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:26.442009 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:26.910135 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:26.918235 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-22b0535c-e016-4454-ae2f-2dbd7a6e9b54 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.489399 May 20 09:24:26.918812 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 555/1093] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:26 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:27.940933 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:27.942113 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:27.951294 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:27.951778 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:27.952535 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:27.952960 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:28.090945 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:28.098893 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e25a8b8c-0da4-4da0-9807-03a0345ee2ef tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.165812 May 20 09:24:28.099506 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 539/1094] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:27 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:29.120052 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:29.120895 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:29.131877 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:29.132611 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:29.133811 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:29.134522 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:29.274268 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:29.282121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4b06106f-e9bf-4618-8dfe-7b9d090eb7fd tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.168764 May 20 09:24:29.282698 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 556/1095] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:29 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:30.303325 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:30.304447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:30.313769 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:30.314219 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:30.314983 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:30.315466 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:30.453348 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:30.462283 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a3f4197a-4e1c-4985-a3bf-8055f30c90fc tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.165577 May 20 09:24:30.462853 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 540/1096] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:30 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:31.487941 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:31.488564 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:31.496204 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:31.496842 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:31.497889 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:31.498370 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:31.634696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:31.642676 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a30cbbf9-a2f0-46d5-b83b-19520161d4d7 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.165831 May 20 09:24:31.643288 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 557/1097] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:31 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:32.663892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:32.664969 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:32.675627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:32.676385 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:32.677630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:32.678346 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:32.767345 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:32.785196 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:32.821857 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:32.831142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3a331071-a6be-4f45-bcf9-c40b9fd1c344 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.173857 May 20 09:24:32.831757 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 541/1098] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:32 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:33.852252 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:33.853242 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:33.856989 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:24:33.863084 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:33.863547 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:33.864300 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:33.864722 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:33.993627 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:34.001528 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4b971ecb-4f25-4e9c-b97b-21687cdb018a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.155696 May 20 09:24:34.002068 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 558/1099] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:33 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:35.018760 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:35.019367 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:35.026134 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:35.026546 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:35.027287 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:35.027766 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:35.166023 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:35.174202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7827456c-00d2-4553-9d03-650e7297eb7f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.159466 May 20 09:24:35.174773 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 542/1100] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:35 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:36.193727 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:36.194369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:36.202411 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:36.202932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:36.203851 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:36.204358 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:36.341128 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:36.349022 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d2e92d0f-ea55-4e53-99d1-9f5e4a1aca72 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.160122 May 20 09:24:36.349604 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 559/1101] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:36 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:37.104309 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-c4c8fc96-eda8-45d5-90b1-1e8012f2c0aa req-1d5affd2-238f-4044-82ab-112083b31bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "name": "network-vif-plugged", "status": "completed", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:37.112610 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c4c8fc96-eda8-45d5-90b1-1e8012f2c0aa req-1d5affd2-238f-4044-82ab-112083b31bf4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:37.113068 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c4c8fc96-eda8-45d5-90b1-1e8012f2c0aa req-1d5affd2-238f-4044-82ab-112083b31bf4 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:37.124178 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-c4c8fc96-eda8-45d5-90b1-1e8012f2c0aa req-1d5affd2-238f-4044-82ab-112083b31bf4 service nova] Creating event network-vif-plugged:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:24:37.129379 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-c4c8fc96-eda8-45d5-90b1-1e8012f2c0aa req-1d5affd2-238f-4044-82ab-112083b31bf4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147629 May 20 09:24:37.129940 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 543/1102] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:24:37.366330 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:37.367148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:37.373977 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:37.374356 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:37.375148 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:37.375608 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:37.504756 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:37.512447 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-556a28b4-2818-49e4-9338-a69dc31f97a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1259 microversion: 2.1 time: 0.150074 May 20 09:24:37.513369 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 560/1103] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:37 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:38.535627 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:38.536763 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:38.547955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:38.548685 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:38.549918 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:38.550623 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:38.694370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:38.702370 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2404c32d-80d7-41fc-a337-526fcd9c5270 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1443 microversion: 2.1 time: 0.174713 May 20 09:24:38.702947 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 544/1104] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:38 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:38.720342 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:24:38.720944 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:24:38.727935 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:38.728375 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:38.729121 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:38.729544 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:38.872236 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:24:38.879878 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-45ddcaa6-6f9c-4993-bcbc-41ccef07cc05 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1443 microversion: 2.1 time: 0.164999 May 20 09:24:38.880427 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 561/1105] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:24:38 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:24:40.666894 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-205d8cdc-82a0-48b2-99ed-b71d7df3ea12 req-187488d6-b6ba-4db1-8d11-baa62b8eaa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:24:40.676253 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-205d8cdc-82a0-48b2-99ed-b71d7df3ea12 req-187488d6-b6ba-4db1-8d11-baa62b8eaa29 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:24:40.676686 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-205d8cdc-82a0-48b2-99ed-b71d7df3ea12 req-187488d6-b6ba-4db1-8d11-baa62b8eaa29 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:24:40.687630 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-205d8cdc-82a0-48b2-99ed-b71d7df3ea12 req-187488d6-b6ba-4db1-8d11-baa62b8eaa29 service nova] Creating event network-changed:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:24:40.692759 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-205d8cdc-82a0-48b2-99ed-b71d7df3ea12 req-187488d6-b6ba-4db1-8d11-baa62b8eaa29 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029667 May 20 09:24:40.693409 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 545/1106] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:25:30.650040 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:25:30.650696 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Fri May 20 09:25:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:26:35.718105 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94aa7497-f322-4beb-bb31-e47c59d199d4] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 20 09:26:35.719328 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=20 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:26:35.720514 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=48 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:26:35.727034 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:26:35.727944 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:35.738382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:35.738826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:35.739626 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:35.740059 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:35.762508 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lazy-loading 'flavor' on Instance uuid 34a9ac2e-c759-4617-9015-0a534a8df985 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 20 09:26:35.841853 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-256988e6-1eaa-4dde-bff1-6e681c1eeaec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "POST /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985/action" status: 202 len: 0 microversion: 2.1 time: 0.126879 May 20 09:26:35.842386 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 562/1107] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:26:35 2022] POST /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:26:35.851700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dcfebf3-9eec-4c1d-a2fd-3a724fa218f2] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 20 09:26:35.851700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:26:35.852671 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=44 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:26:35.858381 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:35.859092 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:35.867292 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:35.867782 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:35.868710 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:35.869059 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:36.008884 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:36.021637 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-96ef3c67-251a-40b5-bef3-4a5cefe9738d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.173597 May 20 09:26:36.022353 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 546/1108] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:35 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:37.050120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:37.050669 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:37.057717 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:37.058159 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:37.058907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:37.059368 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:37.064644 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] [94aa7497-f322-4beb-bb31-e47c59d199d4] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 51526. May 20 09:26:37.205104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:37.213417 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a2c615fa-49b5-40f4-9314-f376a302a75b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.171963 May 20 09:26:37.213990 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 563/1109] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:37 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:38.234187 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:38.235119 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:38.247325 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:38.248105 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:38.249344 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:38.250054 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:38.256349 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dcfebf3-9eec-4c1d-a2fd-3a724fa218f2] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 51530. May 20 09:26:38.395183 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:38.403172 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5ebaf714-68e7-4cbe-b8c5-fbe4c1129f43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.175672 May 20 09:26:38.403834 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 547/1110] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:38 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:39.425157 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:39.425868 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:39.433800 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:39.434316 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:39.435194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:39.435732 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:39.567847 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:39.575521 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-99522b38-e665-452e-a47e-aa0ed7109c18 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.157134 May 20 09:26:39.576087 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 564/1111] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:39 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:40.596638 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:40.597703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:40.605721 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:40.606233 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:40.607106 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:40.607636 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:40.753554 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:40.762072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f57f3b19-8348-4a8b-82fb-5eeec23bea4c tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.171997 May 20 09:26:40.762645 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 548/1112] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:40 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:41.783194 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:41.784256 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:41.795342 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:41.796075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:41.797330 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:41.798045 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:41.938708 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:41.948477 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c063e709-bca8-4e56-bdd4-0385827472ec tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.171782 May 20 09:26:41.949051 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 565/1113] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:41 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:42.970036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:42.971044 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:42.982024 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:42.982751 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:42.984049 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:42.984753 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:43.118887 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:43.126661 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3107ccf4-e120-4879-8381-1a5cce3e2b3e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.163273 May 20 09:26:43.127230 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 549/1114] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:42 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:43.960196 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:26:43.960548 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Fri May 20 09:26:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:26:44.147808 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:44.148779 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:44.160032 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:44.160772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:44.162060 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:44.162768 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:44.294907 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:44.302615 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8eec7cc9-6335-4d1e-89d3-4c19ce389927 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.161513 May 20 09:26:44.303156 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 566/1115] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:44 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:45.324265 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:45.325157 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:45.336941 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:45.337692 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:45.338446 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:45.338899 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:45.479717 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:45.487680 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-56068ca2-e04a-471e-a43a-92bf04da472b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.170250 May 20 09:26:45.488237 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 550/1116] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:45 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:46.505377 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:46.506033 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:46.513313 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:46.513759 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:46.514529 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:46.514955 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:46.808666 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:46.816802 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4c6d76ec-e0fa-448c-bbc0-9c7dab02e1a8 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.315359 May 20 09:26:46.817357 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 567/1117] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:46 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:47.836191 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:47.836992 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:47.844290 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:47.844732 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:47.845505 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:47.845931 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:47.990831 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:48.000278 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7c86471a-00c3-4397-a373-b61aebd21441 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.169411 May 20 09:26:48.000848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 551/1118] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:47 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:49.019327 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:49.020150 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:49.028304 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:49.028827 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:49.029810 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:49.030312 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:49.177882 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:49.185833 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fa1529a9-2009-4169-bfe7-0264e2fcd89b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1569 microversion: 2.1 time: 0.171759 May 20 09:26:49.186378 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 568/1119] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:49 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:49.202226 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:26:49.202820 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:49.209536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:49.209972 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:49.210725 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:49.211153 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:49.411502 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9ae5219c-6f81-4971-bac0-21a30dd8427f tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "POST /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985/action" status: 202 len: 0 microversion: 2.1 time: 0.213144 May 20 09:26:49.412101 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 552/1120] 10.222.0.69 () {60 vars in 1277 bytes} [Fri May 20 09:26:49 2022] POST /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:26:49.420502 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:49.421142 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:49.427616 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:49.428053 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:49.428800 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:49.429243 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:49.560058 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:49.567934 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4191ff37-d0bc-46b1-885c-d99f8b2c46a1 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1517 microversion: 2.1 time: 0.151482 May 20 09:26:49.568654 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 569/1121] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:49 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:50.585840 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:50.586427 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:50.593528 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:50.593994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:50.594747 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:50.595142 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:50.756206 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:50.764350 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9e7f8e59-4dfa-4f0f-ab84-ddcb8293584a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1519 microversion: 2.1 time: 0.183362 May 20 09:26:50.765004 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 553/1122] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:50 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:51.637184 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-4a749d20-0e96-47f0-9de5-6c379ee73916 req-c6e9080b-d60f-423d-b325-3594a32963e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "name": "network-vif-unplugged", "status": "completed", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:26:51.646338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4a749d20-0e96-47f0-9de5-6c379ee73916 req-c6e9080b-d60f-423d-b325-3594a32963e1 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:51.646861 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4a749d20-0e96-47f0-9de5-6c379ee73916 req-c6e9080b-d60f-423d-b325-3594a32963e1 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:51.659048 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-4a749d20-0e96-47f0-9de5-6c379ee73916 req-c6e9080b-d60f-423d-b325-3594a32963e1 service nova] Creating event network-vif-unplugged:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:26:51.664292 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-4a749d20-0e96-47f0-9de5-6c379ee73916 req-c6e9080b-d60f-423d-b325-3594a32963e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031291 May 20 09:26:51.664898 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 570/1123] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:26:51.783036 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:51.783647 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:51.790703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:51.791155 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:51.791955 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:51.792392 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:51.934085 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:51.945829 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7843fa4c-24c1-4eaf-b864-325a5d00b121 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.166607 May 20 09:26:51.946597 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 554/1124] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:51 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:52.969338 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:52.970472 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:52.980094 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:52.980536 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:52.981321 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:52.981745 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:53.122471 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:53.130442 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2220da43-f2d3-48fd-bc97-14933dd216e3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.169064 May 20 09:26:53.130963 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 571/1125] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:52 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:54.157354 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:54.158237 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:54.168171 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:54.168621 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:54.169396 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:54.169832 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:54.306216 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:54.314072 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5016fd68-287e-46bb-96a7-83dbf9355d0a tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.163491 May 20 09:26:54.314678 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 555/1126] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:54 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:55.332025 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:55.332634 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:55.339730 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:55.340174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:55.340932 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:55.341571 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:55.479995 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:55.488240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-34e5d6d2-5664-4f2d-8588-83f18c16e9f2 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.161280 May 20 09:26:55.488829 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 572/1127] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:55 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:56.509769 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:56.510545 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:56.519466 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:56.520018 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:56.520951 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:56.521485 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:56.668202 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:56.680011 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-adeadb33-2f59-48a4-9de5-c65e021cfa3b tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.176675 May 20 09:26:56.680828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 556/1128] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:56 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:57.702147 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:57.702693 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:57.709507 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:57.709948 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:57.710694 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:57.711120 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:57.864029 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:57.872173 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5621658e-09e6-4348-b750-1a71c8d904c3 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.173985 May 20 09:26:57.872747 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 573/1129] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:57 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:26:58.652982 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:26:58.653382 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Fri May 20 09:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:26:58.789573 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:26:58.790050 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Fri May 20 09:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:26:58.894672 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:26:58.895312 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:26:58.902447 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:58.902892 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:58.903883 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:26:58.904115 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:26:59.064449 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:26:59.072705 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e2a23259-661e-44c2-85a8-6f64a48e8cd5 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1575 microversion: 2.1 time: 0.182082 May 20 09:26:59.073275 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 557/1130] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:26:58 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:27:00.092920 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:27:00.093480 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:27:00.100104 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:27:00.100686 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:27:00.101459 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:27:00.101888 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:27:00.236975 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:27:00.244513 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-814f35eb-b082-4a60-8e8d-f41299f8ee43 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1562 microversion: 2.1 time: 0.157135 May 20 09:27:00.245090 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 574/1131] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:27:00 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:27:01.759488 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "name": "network-vif-plugged", "status": "completed", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:27:01.770225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:27:01.770225 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:27:01.781818 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] Creating event network-vif-plugged:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:27:01.785347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR oslo.messaging._drivers.impl_rabbit [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] [579caba7-c507-4344-9097-797630df90cd] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 20 09:27:02.794532 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] [579caba7-c507-4344-9097-797630df90cd] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 51622. May 20 09:27:02.799300 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-55baec37-1404-45f9-a417-24c2b6074967 req-8e643991-bbed-44f4-8691-43b6a99ae436 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043734 May 20 09:27:02.800361 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 558/1132] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:28:10.570647 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=26 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:28:10.571548 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:28:10.573752 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=28 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:28:10.574833 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 20 09:28:10.576272 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:28:10.576760 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:28:10.580206 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-c66dba8b-e3fa-422b-93dd-b6f463e61ff9 req-8ac7ff4d-e502-40c3-b166-39981c9f365c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:28:10.590660 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c66dba8b-e3fa-422b-93dd-b6f463e61ff9 req-8ac7ff4d-e502-40c3-b166-39981c9f365c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:10.591201 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-c66dba8b-e3fa-422b-93dd-b6f463e61ff9 req-8ac7ff4d-e502-40c3-b166-39981c9f365c service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:10.597199 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:10.597721 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:10.598535 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:10.598960 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:10.606030 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-c66dba8b-e3fa-422b-93dd-b6f463e61ff9 req-8ac7ff4d-e502-40c3-b166-39981c9f365c service nova] Creating event network-changed:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:28:10.611772 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-c66dba8b-e3fa-422b-93dd-b6f463e61ff9 req-8ac7ff4d-e502-40c3-b166-39981c9f365c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040435 May 20 09:28:10.612452 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 559/1133] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:28:10.628066 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} May 20 09:28:10.715795 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0db03f98-7f17-4cc0-a1e4-fe3baf60ae1d tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "DELETE /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 204 len: 0 microversion: 2.1 time: 0.146674 May 20 09:28:10.716450 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 575/1134] 10.222.0.69 () {58 vars in 1238 bytes} [Fri May 20 09:28:10 2022] DELETE /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 20 09:28:10.726536 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:28:10.727337 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:28:10.735848 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:10.736443 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:10.737270 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:10.737764 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:10.879994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:28:10.887922 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-67b5e14a-8690-44dc-bdd4-f19804f3ded9 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.166045 May 20 09:28:10.888498 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 560/1135] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:28:10 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:28:11.911010 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:28:11.912205 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:28:11.923169 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:11.923945 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:11.925164 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:11.925715 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:12.135174 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:28:12.142826 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f1270cca-964b-4736-bf11-200a6b71031e tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1568 microversion: 2.1 time: 0.238832 May 20 09:28:12.143396 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 576/1136] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:28:11 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:28:12.957890 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-cfb61741-25da-421b-b243-378c120a2fc7 req-ec29a702-982a-492c-b9dc-d5c3337ea055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a9ac2e-c759-4617-9015-0a534a8df985", "name": "network-vif-deleted", "tag": "da240909-826c-4043-959d-b2c8d848c327"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 20 09:28:12.968006 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-cfb61741-25da-421b-b243-378c120a2fc7 req-ec29a702-982a-492c-b9dc-d5c3337ea055 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:12.968661 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-cfb61741-25da-421b-b243-378c120a2fc7 req-ec29a702-982a-492c-b9dc-d5c3337ea055 service nova] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:12.980900 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-cfb61741-25da-421b-b243-378c120a2fc7 req-ec29a702-982a-492c-b9dc-d5c3337ea055 service nova] Creating event network-vif-deleted:da240909-826c-4043-959d-b2c8d848c327 for instance 34a9ac2e-c759-4617-9015-0a534a8df985 on hv-cinder-83699 May 20 09:28:12.987320 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-cfb61741-25da-421b-b243-378c120a2fc7 req-ec29a702-982a-492c-b9dc-d5c3337ea055 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 May 20 09:28:12.987994 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 561/1137] 10.222.0.69 () {64 vars in 1317 bytes} [Fri May 20 09:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 20 09:28:13.163555 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:28:13.164240 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:28:13.172831 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:13.173306 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:13.174239 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:13.174772 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:13.245388 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd753eff4043144aa930f3b1b15058fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0855d455651d42709d1baa57d5647015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} May 20 09:28:13.253843 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ac3bfe5f-a4e3-4b94-a246-5581f42159e6 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 200 len: 1218 microversion: 2.1 time: 0.095630 May 20 09:28:13.255407 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 577/1138] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:28:13 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 20 09:28:14.273641 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:28:14.274386 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] [instance: 34a9ac2e-c759-4617-9015-0a534a8df985] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} May 20 09:28:14.281081 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:14.281522 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:14.282274 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 20 09:28:14.282703 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Lock "cfb14b34-4b8d-44b3-b921-227f159daefa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 20 09:28:14.296255 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] HTTP exception thrown: Instance 34a9ac2e-c759-4617-9015-0a534a8df985 could not be found. May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Request method failure captured: May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 HTTP/1.1 May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept: application/json May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Connection: close May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Length: 0 May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Content-Type: application/json May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Host: 10.222.0.69 May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABih14w4pvgc_0OCIdxBF8I-Wdd97Kmu8WGot8C-F68iGn0IIHDQA5YS4QXxcxDsiBjUqaLbHb_rpdVJCcAYujCDHHoOjbB5tRN3FG_sO2ws-z3RQLFUP9J1nnyU8Rg5E9hzkm77Km0Jo1pO3zeafeSLC_9jei1HapndjCYI6miaIKXEOY May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Id: None May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Domain-Name: None May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Id: 0855d455651d42709d1baa57d5647015 May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestShelveInstance-1746726864 May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Role: member,reader May 20 09:28:14.297912 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Roles: member,reader May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0855d455651d42709d1baa57d5647015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0855d455651d42709d1baa57d5647015", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0855d455651d42709d1baa57d5647015"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0855d455651d42709d1baa57d5647015"}]}] May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestShelveInstance-1746726864 May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 0855d455651d42709d1baa57d5647015 May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestShelveInstance-1746726864 May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User: tempest-TestShelveInstance-1746726864-project May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Id: d753eff4043144aa930f3b1b15058fbc May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestShelveInstance-1746726864-project May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: method: > May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: exception: Instance 34a9ac2e-c759-4617-9015-0a534a8df985 could not be found. May 20 09:28:14.299619 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: action_args: {'id': '34a9ac2e-c759-4617-9015-0a534a8df985'} May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a9ac2e-c759-4617-9015-0a534a8df985 could not be found. May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 20 09:28:14.300700 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a9ac2e-c759-4617-9015-0a534a8df985 could not be found. May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a9ac2e-c759-4617-9015-0a534a8df985 could not be found. May 20 09:28:14.302347 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi May 20 09:28:14.303836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Returning 404 to user: Instance 34a9ac2e-c759-4617-9015-0a534a8df985 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 20 09:28:14.303836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-75d6afba-7009-4b38-a42f-205595c5c167 tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985" status: 404 len: 111 microversion: 2.1 time: 0.030454 May 20 09:28:14.303836 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 562/1139] 10.222.0.69 () {58 vars in 1235 bytes} [Fri May 20 09:28:14 2022] GET /compute/v2.1/servers/34a9ac2e-c759-4617-9015-0a534a8df985 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 20 09:28:14.466127 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a39f4fdd-e354-41d5-984d-0f87975606fb tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] Calling method '.version_select at 0x7f7c907f74c0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 20 09:28:14.492088 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a39f4fdd-e354-41d5-984d-0f87975606fb tempest-TestShelveInstance-1746726864 tempest-TestShelveInstance-1746726864-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-772639027" status: 202 len: 0 microversion: 2.1 time: 0.029492 May 20 09:28:14.492701 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 578/1140] 10.222.0.69 () {58 vars in 1250 bytes} [Fri May 20 09:28:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-772639027 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 20 09:28:50.662905 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:28:50.664075 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Fri May 20 09:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:30:03.973750 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:30:03.974431 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Fri May 20 09:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:30:18.800324 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:30:18.800942 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Fri May 20 09:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:32:10.676924 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:32:10.677915 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Fri May 20 09:32:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:33:23.986079 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:33:23.987042 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Fri May 20 09:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:33:38.668823 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:33:38.669438 dv-cinder-836996-23-iscsi devstack@n-api.service[117980]: Fri May 20 09:33:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 20 09:33:38.809828 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 20 09:33:38.810332 dv-cinder-836996-23-iscsi devstack@n-api.service[117981]: Fri May 20 09:33:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!